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Description 

Background of the Invention 



5 1 . Field of the Invention 



The present invention relates an image coding apparatus, an image coding method, an image decoding apparatus, 
an image decoding method, a record medium and an image transmitting method, and more specifically, to an image 
coding apparatus and an image coding method, an image encoding apparatus, an image decoding method, a record 
io medium and an image transmitting method capable of producing a prediction image with a higher image quality in a 
high efficiency by executing less data process operation. 



2. Description of the Related Art 

is Conventionally, various sorts of image compressing methods have been proposed. Among these conventional 
image compressing methods, there is one image compressing method which compresses by thinning (subsampling) 
pixels of an image. , 

However, when pixel data produced by simply thinning an image to compress the thinned image is directly coded, 
the total amount of data to be processed becomes huge. Therefore, because of the huge processing requirements, pre- 

20 diction images having a high image quality could not effectively be obtained effectively. Accordingly, it would be desira- 
ble to obtain a high efficiency prediction image with a higher image quality utilizing a small amount of data. 



Summary of the Invention 



25 It is an object of the present invention to efficiently code image data. 

It is a feature of the present invention to provide high image quality utilizing a small amount of data. 
It is an advantage of the present invention to reduce the amount of transmitted or recorded data necessary to pro- 
vide high quality images. 

In accordance with an aspect of the present invention an apparatus for coding image data having a plurality of pix- 

30 els includes means for reducing a number of pixels of original image data to generate compressed data, means for lim- 
iting a level of pixels of the compressed data to generate limited compressed data, means for correcting the limited 
compressed data to generate corrected data, means for predicting the original image data in accordance with the cor- 
rected data and for generating predicted data having a plurality of predicted pixels, means for calculating, with respect 
to the original image data, a predictive error of the predicted data, means for determining suitability of the corrected data 

35 as coded data based upon the predicted error and means for outputting the corrected data as coded data of the original 
image data based upon the determined suitability. 

According to another aspect of the present invention an apparatus for decoding coded data generated by coding 
image data includes means for receiving the coded data, and means for decoding the coded data and generating 
decoded image data, wherein the coded data is generated by the steps of reducing a number of pixels of original image 

40 data to generate compressed data, limiting a level of pixels of the compressed data to generate limited compressed 
data, correcting the limited compressed data to generate corrected data, predicting the original image data in accord- 
ance with the corrected data and generating predicted data having a plurality of predicted pixels, calculating, with 
respect to the original image data, a predictive error of the predicted data, determining suitability of the corrected data 
as coded data based upon the predicted error, repeating the step of correcting until the corrected data becomes an opti- 

45 mum corrected data, and outputting the optimum corrected data as coded data. 

According to yet another aspect of the present invention a method for coding image data having a plurality of pixels 
includes the steps of reducing a number of pixels of original image data to generate compressed data, limiting a level 
of pixels of the compressed data to generate limited compressed data, correcting the limited compressed data to gen- 
erate corrected data, predicting the original image data in accordance with the corrected data and generating predicted 

so data having a plurality of predicted pixels, calculating, with respect to the original image data, a predictive error of the 
predicted data, determining suitability of the corrected data as coded data of the original image based upon the pre- 
dicted error, and outputting the corrected data as coded data of the original image data based upon the determined suit- 
ability. 

According to a further aspect of the present invention a method for decoding coded data generated by coding 
55 image data, includes the steps of receiving the coded data, and decoding the coded data and generating decoding 
image data, wherein the coded data is generated by the steps of reducing a number of pixels of original image data to 
generate compressed data, limiting a level of pixels of the compressed data to generate limited compressed data, cor- 
recting the limited compressed data to generate corrected data, predicting the original image data in accordance with 
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the corrected data and for generating predicted data having a plurality of predicted pixels, calculating, with respect to 
the original image data, a predictive error of the predicted data, determining suitability of the corrected data as coded 
data based upon the predicted error, and outputting the corrected data as coded data of the original image data based 
upon the determined suitability. 

5 According to yet a further aspect of the present invention an apparatus for coding image data having a plurality of 

pixels, includes a subsampling circuit for reducing a number of pixels of original image data to generate compressed 
data, a limiting circuit for limiting a level of pixels of the compressed data to generate limited compressed data, a cor- 
recting circuit for correcting the limited compressed data to generate corrected data, a predicting circuit for predicting 
the original image data in accordance with the corrected data* and for generating predicted data having a plurality of pre- 

10 dieted pixels, a calculator for calculating, with respect to the original image data, a predictive error of the predicted data, 
a determining circuit for determining suitability of the corrected data as coded data based upon the predicted error, and 
an output circuit for outputting the corrected data as coded data of the original image data based upon the determined 
suitability. 

According to an additional aspect of the present invention an apparatus for decoding coded data generated by cod- 
is ing image data includes a circuit for receiving the coded data, and a decoder for decoding the coded data and generat- 
ing decoding image data, wherein the coded data is generated by the steps of reducing a number of pixels of original 
image data to generate compressed data, limiting a level of pixels of the compressed data to generate limited com- 
pressed data/correcting the limited compressed data to generate corrected data, predicting the original image data in 
accordance with the corrected data and for generating predicted data having a plurality of predicted pixels, calculating, 
20 with respect to the original image data, a predictive error of the predicted data, determining suitability of the corrected 
data as coded data based upon the predicted error, and outputting the corrected data as coded data of the original 
image data based upon the determined suitability. 

According an aspect of the present invention a method for transmitting image data having a plurality of pixels, 
includes the steps of reducing a number of pixels of original image data to generate compressed data, limiting a level 
25 of pixels of the compressed data to generate limited compressed data, correcting the limited compressed data to gen- 
erate corrected data, predicting the original image data in accordance with the corrected data and for generating pre- 
dicted data having a plurality of predicted pixels, calculating, with respect to the original image data, a predictive error 
of the predicted data, determining suitability of the corrected data as coded data based upon the predicted error, out- 
putting the corrected data as coded data of the original image data based upon the determined suitability, and transmit- 
30 ting the outputted corrected data. 

According to a further aspect of the present invention a recording medium has an encoded digital signal recorded 
thereon, the recording medium being prepared by the steps of reducing a number of pixels of original image data to 
generate compressed data, limiting a level of pixels of the compressed data to generate limited compressed data, cor- 
recting the limited compressed data to generate corrected data, predicting the original image data in accordance with 
35 the corrected data and for generating predicted data having a plurality of predicted pixels, calculating, with respect to 
the original image data, a predictive error of the predicted data, determining suitability of the corrected data as coded 
data based upon the predicted error, outputting the corrected data as coded data of the original image data based upon 
the determined suitability, and recording the coded data on the recording medium. 

According to an additional aspect of the present invention a method for coding data having a plurality of samples. 
40 includes the steps of reducing a number of samples of original data to generate compressed data, limiting a level of 
samples of the compressed data to generate limited compressed data, correcting the limited compressed data to gen- 
erate corrected data, predicting the original data in accordance with the corrected data and generating predicted data 
having a plurality of predicted samples, calculating, with respect to the original data, a predictive error of the predicted 
data, determining suitability of the corrected data as coded data of the original data based upon the predicted error, and 
45 outputting the corrected data as coded data of the original data based upon the determined suitability. 

According to yet another aspect of the present invention, a method for decoding coded data generated by coding 
data, includes the steps of receiving the coded data, and decoding the coded data and generating decoding data, 
wherein the coded data is generated by the steps of limiting a level of samples of the compressed data to generate lim- 
ited compressed data, correcting the limited compressed data to generate corrected data, predicting the original data 
so in accordance with the corrected data and for generating predicted data having a plurality of predicted samples, calcu- 
lating, with respect to the original data, a predictive error of the predicted data, determining suitability of the corrected 
data as coded data based upon the predicted error, and outputting the corrected data as coded data of the original data 
based upon the determined suitability. 

According to a further aspect of the present invention, an apparatus for coding data having a plurality of samples 
55 includes a subsampling circuit for reducing a number of samples of original data to generate compressed data, a limit- 
ing circuit for limiting a level of samples of the compressed data to generate limited compressed data, a correcting cir- 
cuit for correcting the limited compressed data to generate corrected data, a predicting circuit for predicting the original 
data in accordance with the corrected data and for generating predicted data having a plurality of predicted samples.a 



3 



EP 0 820 195 A2 



calculator for calculating, with respect to the original data, a predictive error of the predicted data, a determining circuit 
for determining suitability of the corrected data as coded data based upon the predicted error, and an output circuit for 
outputting the corrected data as coded data of the original data based upon the determined suitability. 

According to yet another aspect of the present invention an apparatus for decoding coded data generated by cod- 
ing data includes a circuit for receiving the coded data, and a decoder for decoding the coded data and generating 
decoding data wherein the coded data is generated by the steps of reducing a number of samples of original data to 
generate compressed data, correcting the compressed data to generate corrected data, predicting the original data in 
accordance with the corrected data and for generating predicted data having a plurality of predicted samples, calculat- 
ing with respect to the original data, a predictive error of the predicted data, determining suitability of the corrected data 
as coded data based upon the predicted error, and outputting the corrected data as coded data of the original data 
based upon the determined suitability. 

According to an aspect of the present invention, an apparatus for coding image data having a plurality of pixels 
includes means for extracting a plurality of pixels of the image data and generating class information corresponding to 
characteristics of the extracted plurality of pixels, means for storing mapping coefficients for each class, means for read- 
ing mapping coefficients for each class, means for reading mapping coefficients corresponding to the class information 
and for producing corrected data using the image data and the read mapping coefficients, and means for producing 
coded data by limiting a level of pixels of the corrected data. 

According to another aspect of the present invention, an apparatus for decoding coded data generated by coding 
image data, includes means for receiving the coded data, and means for decoding the coded data to produce decoded 
image data said coded data generated by the steps of extracting a plurality of pixels of the image data and generating 
class information corresponding to characteristics of the extracted plurality of pixels, storing mapping coefficients for 
each class reading mapping coefficients for each class, reading mapping coefficients corresponding to the class infor- 
mation and for producing corrected data using the image data and the read mapping coefficients, and producing coded 
data by limiting a level of pixels of the corrected data. 

According to yet a further aspect of the present invention, a method for coding image data having a plurality of pix- 
els includes the steps of extracting a plurality of pixels of the image data and generating class information correspond- 
ing' to characteristics of the extracted plurality of pixels, storing mapping coefficients for each class, reading mapping 
coefficients for each class, reading mapping coefficients corresponding to the class information and for producing cor- 
rected data using the image data and the read mapping coefficients, and producing coded data by limiting a level of pix- 
els of the corrected data. . . 

According to another aspect of the present invention, a method for decoding coded data generated by coding 
image data includes the steps of receiving the coded data, and decoding the coded data to produce decoded image 
data, said coded data generated by the steps of extracting a plurality of pixels of the image data and generating class 
information corresponding to characteristics of the extracted plurality of pixels, storing mapping coefficients for each 
class reading mapping coefficients for each class, reading mapping coefficients corresponding to the class information 
and for producing corrected data using the image data and the read mapping coefficients, and producing coded data 
by limiting a level of pixels of the corrected data. 

According to an additional aspect of the present invention, a method for transmitting image data having a plurality 
of pixels, includes the steps of extracting a plurality of pixels of the image data and generating class information corre- 
sponding to characteristics of the extracted plurality of pixels, storing mapping coefficients for each class, reading map- 
ping coefficients for each class, reading mapping coefficients corresponding to the class information and for producing 
corrected data using the image data and the read mapping coefficients, producing coded data by limiting a level of pix- 
els of the corrected data, and transmitting the coded data. 

According to an aspect of the present invention, a method for transmitting image data having a plurality of pixels, 
includes the steps of extracting a plurality of pixels of the image data and generating class information corresponding 
to characteristics of the extracted plurality of pixels, storing mapping coefficients for each class, reading mapping coef- 
ficients for each class, reading mapping coefficients corresponding to the class information and for producing corrected 
data using the image data and the read mapping coefficients, producing coded data by limiting a level of pixels of the 
corrected data, and transmitting the coded data. 

According to an additional aspect of the present invention, a recording medium has an encoded digital signal 
recorded thereon, the recording medium being prepared by the steps of extracting a plurality of pixels of the image data 
and generating class information corresponding to characteristics of the extracted plurality of pixels, storing mapping 
coefficients for each class, reading mapping coefficients for each class, reading mapping coefficients corresponding to 
the class information and for producing corrected data using the image data and the read mapping coefficients, produc- 
ing coded data by limiting a level of pixels of the corrected data, and recording the coded data on the recording medium. 

According to a further aspect of the present invention, an apparatus for coding image data having a plurality of pix- 
els, includes a subsampling circuit for extracting a plurality of pixels of the image data and generating class information 
corresponding to characteristics of the extracted plurality of pixels, a memory storing mapping coefficients for each 
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class, a circuit for reading mapping coefficients for each class, a circuit for reading mapping coefficients corresponding 
to the class information and for producing corrected data using the image data and the read mapping coefficients, and 
a limiting circuit for producing coded data by limiting a level of pixels of the corrected data. 

According to another aspect of the present invention, an apparatus for decoding coded data generated by coding 

5 image data, includes a circuit for receiving the coded data, and a decoder for decoding the coded data to produce 
decoded image data, said coded data generated by the steps of extracting a plurality of pixels of the image data and 
generating class information corresponding to characteristics of the extracted plurality of pixels, storing mapping coef- 
ficients for each class, reading mapping coefficients for each class, reading mapping coefficients corresponding to the 
class information and for producing corrected data using the image data and the read mapping coefficients, and pro- 

w ducing coded data by limiting a level of pixels of the corrected data. 

According to an additional aspect of the present invention, a method of transmitting coded image data, includes the 
steps of recei ving the coded image data, and transmitting the coded image data, wherein the coded image data is pro- 
duced by the steps of reducing a number of pixels of original image data to generate compressed data, limiting a level 
of pixels of the compressed data to generate limited compressed data, correcting the limited compressed data to gen- 

15 erate corrected data, predicting the original image data in accordance with the corrected data and for generating pre- 
dicted data having a plurality of predicted pixels, calculating, with respect to the original image data, a predictive error 
of the predicted data, determining suitability of the corrected data as coded data based upon the predicted error, and 
outputting the corrected data as coded data of the original image data based upon the determined suitability. 

These and other objects, features, advantages and aspects of the invention will become apparent when considered 

20 with reference to the following description and the accompanying drawings. 

Brief Description of the Drawings 

Figure 1 is a block diagram showing a configuration of an embodiment of the present invention applied to an image 
25 processing system. 

Figure 2 is a block diagram showing an example configuration of the transmitting apparatus 1 . 

Figure 3 is a block diagram of a first embodiment of the transmitting apparatus 1 of Figure 2 (excluding transmit- 
ting/recording device 16). 

Figure 4 is a flow chart illustrating the operation of the transmitting apparatus 1 of Figure 3. 
30 Figure 5 is a block diagram of the compressing unit 21 of each of Figures 3. 1 9 and 21 . 

Figure 6 is a flow chart illustrating the operation of the compressing unit 21 of Figure 5. 

Figure 7 is an illustration of the process of the thinning-out unit 31 of Figure 5. 

Figure 8 is a block diagram of the local decoder 22 of Figure 3. 

Figures 9(A) and 9(B) illustrate a class classifying process. 
35 Figure 10 is a flow chart illustrating the operation of the local decoder 22 of Figure 8. 

Figure 1 1 is a block diagram of the error calculator 23 of Figures 3 and 28. 

Figure 12 is a flow chart illustrating the operations of the error calculator 23 of Figure 1 1 . 

Figure 13 is a block diagram of the determining unit 24 of Figure 3. 

Figure 14 is a flow chart illustrating the operation of the determining unit of Figure 13. 
40 Figure 1 5 is a block diagram of the receiving apparatus of Figure 1 for use in connection with the transmitting appa- 
ratus of Figure 3. 

Figure 16 is a block diagram of the local decoder 22' of Figure 28. 

Figure 1 7 is a block diagram of an embodiment of an image processing apparatus for calculating the predictive 
coefficients for storage in the predictive coefficient ROM 81 of Figure 16. 
45 Figure 1 8 is a block diagram of a transmitting apparatus 1 of Figure 2 (excluding transmitting/recording device 16) 
according to a fourth and fifth embodiment of the invention. 

Figures 19(A). 19(B) and 19(C) are diagrams which illustrate the ADRC process. 

Figure 20 is a flow chart illustrating the operation of the transmitting apparatus of Figure 18. 

Figure 21 is a block diagram of an image processing apparatus, according to a fourth embodiment, for performing 
so the learning operation used to obtain mapping coefficients. 

Figure 22 is a flow chart illustrating the operation of the image processing apparatus of Figure 21 . 

Figure 23 is a block diagram of the local decoder 127 of Figure 21 . 

Figure 24 is a flow chart illustrating the operation of the local decoder 127 of Figure 23. 

Figure 25 is a block diagram of an image processing apparatus, according to a fifth embodiment, for performing the 
55 learning operation used to obtain mapping coefficients. 

Figure 26 is a flow chart illustrating the operation of the image processing apparatus of Figure 25. 
Figure 27 is a block diagram of a receiving apparatus of Figure 1 for use in connection with the transmitting appa- 
ratus Figure 18. 
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Figure 28 is a block diagram of a transmitting apparatus according to a second embodiment of the invention. 

Figure 29 is a flow chart illustrating the operation of the transmitting apparatus of Figure 28. 

Figure 30 is a block diagram of a transmitting apparatus according to a third embodiment of the invention. 

Figure 31 is a flow chart illustrating the operation of the transmitting apparatus of Figure 30. 

Figure 32 is a block diagram of a local decoder 22" of the transmitting apparatus of Figure 29. 

Figure 33 is a flow chart illustrating the operation of the local decoder 22" of Figure 32. 

Figure 34 is a block diagram of a determining unit 24' of the transmitting apparatus of Figure 30. 

Figure 35 is a flow chart illustrating the operation of transmitting apparatus of Figure 34. 

Figure 36 is a block diagram of a receiving apparatus of Figure 1 for use in connection with the transmitting appa- 
ratus of Figure 30. 

Detailed Description of the Preferred Embodiments 

In order to clarify the corresponding relationship between each of the means of the various embodiments described 
herein, certain characteristics of the present invention are first briefly described with reference to the Figures. It is to be 
understood that the term "unit" is to be interpreted in the broadest sense, including a hard wired circuit, a main frame 
loaded with appropriate software, a programmed microprocessor or micro-controller, or a combination of these. 

. Figure 1 illustrates an arrangement of an embodiment of an image processing apparatus to which the present 
invention is applied. To a transmitting apparatus 1 . digitalized image data is supplied. The transmitting apparatus 1 thins 
(namely, reduces the pixel number thereof, for example by subsampling) the inputted image data to compress/code the 
thinned image data in order to obtain coded image data, and records this coded data on a recording medium 2 such as 
an optical disk, a magneto-optical disk, a magnetic tape, and other recording media, otherwise transmits this coded 
data via a transmission path 3 such as ground waves, a satellite line, a telephone line, a CATV network or other paths. 

In a receiving apparatus 4, the coded data which has been recorded on the recording medium 2 is reproduced, or 
the coded data which has been transmitted via the transmission path 3 is received, and this coded data is expanded 
and decoded to obtain a decoded image which is supplied to a display (not shown) so as to be displayed on this display. 

It should also be noted that the above-described image processing apparatus may utilized with image record- 
ing/reproducing apparatuses, for instance, an optical disk apparatus, a magneto-optical disk apparatus, a magnetic 
tape apparatus, and the like. Alternatively, this image processing apparatus may be utilized with to image transferring 
apparatuses, for example, a television telephone apparatus, a television broadcasting system, a CATV system and the 
like. Also, since a data amount of coded data outputted from the transmitting apparatus 1 is small, the image processing 
apparatus of Figure 1 may be utilized with, for example, a portable telephone, and other portable terminal, the transfer 
rates of which are low. 

Figure 2 shows an example of an arrangement of the above-described transmitting apparatus 1. 

An l/F (Interface) 1 1 is provided to perform a reception process of image data externally supplied thereto, and a 
transmission process of coded data with respect to a transmitting/recording device 1 6. A ROM ( Read Only memory) 1 2 
stores therein a program for an IPL (Initial Program Loading), and other programs. A RAM (Random Access Memory) 
13 is employed so as to store therein a system program (i.e., an operating system) saved in an external storage device 

15, an application program, and also data required for operation of a CPU (Central Processing Unit) 14. The CPU 14 
extends the system program and the application program from the external storage apparatus 15 in accordance with 
the IPL program stored in the ROM 12 to RAM 13, and also executes a decoding process operation (will be explained 
later) as to image data supplied from the l/F 1 1 by executing the application program under control of this system pro- 
gram. The external storage apparatus 15 is constituted by. for example, a magnetic disk apparatus, and as previously 
described, stores therein the system program and the application program executed by the CPU 1 1 , and further stores 
data required in operations of the CPU 14. The transmitting/recording device 16 records the coded data supplied from 
the l/F 1 1 on the recording medium 2, or transmits this coded data via the transmission path 3. 

It should be noted that the above-described l/F 1 1 . ROM 12, RAM 13, CPU 14, and external storage apparatus 15 
are mutually connected via a bus 17. 

In the transmitting apparatus 1 constructed in the above manner, when image data is supplied to the l/F 11, this 
image data is supplied to the CPU 14. The CPU 14 codes the image data, and then supplies the resultant coded data 
to the l/F 1 1 . Upon receipt of the coded data, the l/F 1 1 supplies this coded data to the transmitting/recording apparatus 

16. In the transmitting/recording apparatus 16, the coded data derived from the l/F 11 is recorded on the recording 
medium 2, or is transmitted via the transmission path 3. 

First Embodiment 

With reference now to Figures 3, 4. 5, 6, 8, 10, 11, 12, 13, 14 and, 15 a configuration of a first embodiment of the 
invention is described. Figure 3 is a functional block diagram for showing an internal arrangement of the transmitting 
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apparatus 1 of Figure 2 except for the transmitting/recording device 16. 

The image data (the original image data) to be coded is supplied to a compressing unit 21 , a local decoder 22, and 
an error calculator 23. The compressing unit 21 compresses the image data by simply thinning pixels (subsampling) of 
this image data, and also corrects such compression data (namely, image data which has been thinned and level-lim- 
5 ited) under control of the determining unit 24 by limiting the levels of the extracted pixel data. The corrected data 
obtained by correcting the compression data in the compressing unit 21 is supplied to the local decoder 22 and the 
determining unit 24. 

The local decoder 22 predicts an original image based on the corrected data supplied from the compressing unit 
21 , and then supplies predicted values to the error calculator 23. As will be described later, the local decoder 22 exe- 
w cutes an adaptive process operation so as to obtain predictive coefficients used to calculate the predicted values by way 
of the linear coupling with the correction data. Based upon these predictive coefficients, the local decoder 22 obtains 
the predicted values, which are in turn supplied to error calculator 23. The resultant predictive coefficients are supplied 
to the determining unit 24. 

The error calculator 23 calculates a prediction error of the predicted values derived from the local decoder 22 with 
15 respect to the original image data (original image), which is entered into this error calculator 23. This prediction error is 
supplied as error information to the determining unit 24. 

Based on the error information derived from the error calculator 23, the determining unit 24 judges whether or not 
the corrected data outputted from the compressing unit 21 is correctly equal to the coded result of the original image. 
Then, when the determining unit 24 judges that the corrected data outputted from the compressing unit 21 is not equal 
20 to the coded result of the original image, this determining unit 24 controls the compressing unit 21 to further correct the 
compression data, so that newly obtained corrected data is outputted from this compressing unit 21. Also, when the 
determining unit 24 judges that the corrected data outputted by the compressing unit 21 is correctly equal to the coded 
result of the original image data, the corrected data supplied from the compressing unit 21 is furnished to a multiplexor 
25 as optimum compression data (to be referred to as "optimum compression data" hereinafter, if necessary), and the 
25 predictive coefficients supplied from the local decoder 22 is supplied to the multiplexor 25. 

The multiplexor 25 multiplexes the optimum compression data derived from the determining unit 24 with the predic- 
tive coefficients, and then supplies the multiplexed result as coded data to the transmitting/recording device 16 (Figure 
2). 

Referring now to a flow chart of Figure 4. the operation of the transmitting apparatus of Figure 3 is further explained. 
30 When the image data (the original image data) is supplied to the compressing unit 21 . the compressing unit 21 first 
compresses this image data, at a step S1, while thinning the image data (namely, extracting plural pixels from a large 
number of pixels). At a step S2, levels of the extracted pixel data are limited by extracting 2 bits of this pixel data on the 
MSB side thereof. Then, this pixel data is outputted to the local decoder 22 and the determining unit 24 without any cor- 
rection in the beginning. In the local decoder 22, at a step S3, the corrected data derived from the compressing unit 21 
35 is locally decoded. This corrected data is equal to such a compression data that, as previously explained, the image 
data is simply thinned and also level-controlled in the beginning. 

In other words, at the step S3, the adaptive process operation for obtaining predictive coefficients used to calculate 
predicted values of the original image data is carried out by way of the linear coupling operation with the correction data 
from the compressing unit 21. Then, based on these predictive coefficients, the predicted values are calculated. The- 
40 predicted values calculated in the local decoder 22 are supplied to the error calculator 23, and the predictive coefficients 
are supplied to the determining unit 24. 

In this case, an image constructed of the predicted values outputted from the local decoder 22 is identical to the 
decoded image obtained on the side of the receiving apparatus 4 (Figure 1). 

When the predicted values of the original image data are received from the local decoder 22 by the error calculator 
45 23, at a step S4. the error calculator 23 calculates the prediction error of the predicted values derived from the local 
decoder 22 with respect to the original image data, and supplies this prediction error as the error information to the 
determining unit 24. When the error information is received from the error calculator 23. the determining unit 24 judges 
at a step S5 as to whether or not the corrected data outputted from the compressing unit 21 is correctly equal to the 
coded result of the original image data. 
50 In other words, at a step S5, for instance, a judgment is made as to whether or not the error information is less than 

a predetermined threshold value V. At the step S5, when it is so judged that the error information is not less than the 
predetermined threshold value V, a recognition is made that the corrected data outputted from the compressing unit 
21 is not equal to the coded data of the original image data. Then, the process operation is advanced to a step S6 at 
which the determining unit 24 controls the compressing unit 21 so as to correct the compression data. The compressing 
55 unit 21 varies a correction amount (namely, correction value "A" will be discussed later) under control of the determining 
unit 24 in order to correct the data. The resultant corrected data is outputted to the local decoder 22 and the determining 
unit 24. Then, the process operation is returned to the previous step S3, and a similar process operation will now be 
repeatedly carried out 
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On the other hand, at the step S5, when it is so judged that the error information is less than the predetermined 
threshold value V. a recognition that the corrected data outputted from the compressing unit 21 is correctly equal to 
the coded result of the original image data. The determining unit 24 outputs the correction data when the error informa- 
tion less than the predetermined threshold value V as the optimum correction data in combination with the predictive 
5 coefficient to the multiplexor 25. At a step S7, the multiplexor 25 multiplexes the predictive coefficient with the optimum 
compressed data derived from the determining unit 24, and outputs the multiplexed result as the coded data. Then, the 
process operation is ended. 

As previously explained, since the corrected data produced by correcting the compressed data, such a condition 
that the error information becomes less than a preselected threshold value V is used as the coded result of the original 
w image data, it is possible to obtain such an image substantially identical to the original image data based on this cor- 
rected data on the side of the receiving apparatus 4. 

Next. Figure 5 illustrates an arrangement of the compressing unit 21 of Figure 3. 

The image data (the original image data) to be coded is inputted into a thinning unit 30. The thinning unit 30 may 
thin the inputted image data by 1/N. As a result, such compression data that the image data is compressed by 1/N is 
15 outputted from the thinning unit 30. This compression data is entered into a level limiting unit 31 so as to limit the level 
of this compression data by extracting, for instance, only 2-bit data of the respective pixel data on the side of the MSB 
thereof, and this pixel data is expressed by 8 bits. Then, the level-limited compression data is supplied to a correcting 
unit 32. 

In response to a control signal sent from the determining unit 24 (Figure 3), the correcting unit 32 supplies an 
20 address to a correction value ROM 33, so that the correction value M A" is read out from this ROM. Then, the correcting 
unit 32 produces the corrected data by for example, adding the correction value A read from the correction value ROM 
33 to the compression data from the level limiting unit 31 , and then supplies the produced corrected data to the local 
decoder 22 and the determining unit 24. The correction value ROM 33 stores therein combinations of various sorts of 
correction values A (for instance, a combination of corrected values for correcting compression data for 1 frame) so as 
25 to correct the compression data outputted from the level limiting unit 31 . A combination of correction values A corre- 
sponding to the address supplied from the correcting unit 32 is read from this correction value ROM 32 to be supplied 
to the correcting unit 32. 

Referring now to Figure 6, the operation of the compressing unit 21 shown in Figure 5 is further explained. 

For example, when the image data for 1 frame is supplied to the correcting unit 30, the thinning unit 30 thins this 
30 image data by 1/N at a step Si 1 , and outputs the resultant compression data to the level limiting unit 31 . 

In this case, as indicated in Fig 7, the thinning unit 30 is designed to thin the image data by. for instance. 1/9. That 
is, the thinning unit 30 extracts only a pixel value about a central pixel (portion indicated by symbol in Figure 7) in 
each unit, while 9 pixels of 3 x 3 (transverse direction x longitudinal direction) are used as 1 unit, and also deletes other 
portions (portions indicated by symbol "O " in Figure 7). It should be noted that the thinning unit 30 performs the above- 
35 described process operation in unit of, for instance, 1 frame. As a result, the data produced by that image data for 1 
frame is thinned by 1/9) is supplied as the compression data from the thinning unit 30 to the level limiting unit 31 . It also 
should be noted that the thinning process operation executed in the thinning unit 30 may be alternatively carried out in 
such a manner that an image of 1 frame is subdivided into several blocks, and the thinning process operation is per- 
formed in units of one block. 

40 Upon receipt of the supply of the pixel data thinned by 1/9 from the thinning unit 30, at step S12 the level limiting 
unit 31 limits the level of the thinned pixel data by extracting 2-bit data from the pixel data indicated by 8 bits, from the 
MSB side thereof. In other words, as a consequence, the respective pixel data are expressed by 2 bits, so that the sub- 
sequent process operation may be made simple. 

Upon receipt of the compression data from the level limiting unit 31 , the correcting unit 32 judges as to whether or 

45 not a control signal sent from the determining unit 24 (Figure 3) is received. When it is so judged at the step S13 that 
the control signal is not yet received, the process operation is advanced to a step S16, at which the correcting unit 32 
directly outputs the compression data derived from the level limiting unit 31 as correction data to the local decoder 22 
and the determining unit 24. Then, the process operation is returned to the step S13. 

That is to say. as explained above, the determining unit 24 controls the compressing unit 21 (correcting unit 32) 

so based on the error information. Since the error information is not yet acquired immediately after the compression data 
is received by the level limiting unit 31 (because the error information is not outputted from the error calculator 23), no 
control signal is outputted from the determining unit 24. As a result, just after the compression data is outputted from 
the level limiting unit 31 . the correcting unit 32 does not correct this compression data (to correct by add 0), but directly 
outputs this compression data as the corrected data to the local decoder 22 and the determining unit 24. 

55 On the other hand, in the case that it is so judged at the step S13 that the control signal from the determining unit 
24 is received, the correcting unit 32 outputs an address defined in accordance with this control signal to the correction 
value ROM 33 at a step S14. As a result, at this step S14, the combination (set) of the correction values A stored at this 
address and used to correct the compression data for 1 frame is read at from the correction value ROM 33, and then is 
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supplied to the correcting unit 32. Upon receipt of the combination of the correction value A read from the correction 
value ROM 33. the correcting unit 32 adds the corresponding correction values A to the respective compression data 
for 1 frame, so that the corrected data produced by correcting the compression data for 1 frame is calculated at a step 
S15. Thereafter, the process operation is advanced to a step S16, at which the correction data is outputted from the 

5 correcting unit 32 to the local decoder 22 and the determining unit 24, and then is returned to the step S13. When it is 
determined in step S13 that a control signal having an end of operation state has been received from the determining 
unit 24. the process is returned to step S1 1 . where the thinning unit 30 thins out this image data in step S1 1 by 1/N and 
then the following compressed data is processed in the same way. 

As previously explained, the compressing unit 21 repeatedly outputs the corrected data obtained by correcting the 

w compression data into the various values under control of the determining unit 24. 

It should be noted that when the coding operation as to the image of 1 frame is accomplished, the determining unit 
24 supplies to the compressing unit 21 , such a control signal for indicating this completion of the coding operation. Upon 
receipt of this control signal, the compressing unit 21 executes the process operation defined in the flow chart of Figure 
6 with respect to an image of the next frame. 

15 Also, in the above-described case, the compression data is produced by the thinning unit 30 by extracting only the 
pixel data (pixel value) about the central pixel of the 3 x 3 pixels. Alternatively, for example, an average value of the 3 x 
3 pixels is calculated, and thus, the compression data may be produced by using this average value as the pixel value 
of the central pixel in the 3 x 3 pixels. 

Next Figure 8 illustrates an arrangement of the local decoder 22 shown in Figure 3. 

20 The corrected data derived from the compressing unit 21 is supplied to a block making unit for class classification 
41 and a block making unit for predicted values calculation 42. The block making unit 41 for the class classification 
makes class classifying blocks centered about the noted corrected data in units used to classify the corrected data into 
a preselected class, depending upon a nature thereof. 

In other words, for instance, assuming now that in Figure 7, corrected data (compression data) (or, pixel) (portion 

25 indicated by symbol "•") located at an i-th position from the upper position and at a j-th position from the left position is 
expressed as "Xy". the block making unit 41 for the class classification will constitute a class classifying block arranged 
by 5 pixels in total, namely, a pixel "Xy" of interest and the following 4 pixels adjacent to this pixel of interest at upper, 
left, right, and lower positions: X^.^, XjQ.^, X|q +1 ), X^j. This class classifying block is supplied to a class classification 
adaptive processing circuit 43. 

30 It should be noted, in this case, the class classifying block is constituted by a cross-shaped block, but the shape of 

the class classifying block is not required to be such a cross shape. Alternatively, other shapes, for example, a rectan- 
gular shape, a square shape, and other arbitrary shapes may be employed. Also, a total number of the pixels for con- 
stituting the class classifying block is not limited to 5 pixels. 

The block making unit for the predicted value calculation 42 processes the corrected data to make a predicted val- 

35 ues calculating block centered about the noted corrected data in units used to calculate the predicted values of the orig- 
inal image data. In other words, in Figure 7, assuming now that pixel values of 9 pixels (= 3 x 3) in an original image 
data, while positioning the corrected data Xij (portion denoted by symbol " • " in Figure 7) are expressed from the left- 
most direction to the rightmost direction, and from the upper direction to the lower direction, by: Yy(1), Yy(2) t Yy(3), Yy(4), 
Yy(5), Yjj(6), Yjj(7), Yy(8), Yy(9), the block making unit for the predicted values calculation 42 will constitute a square- 

40 shaped predicted values calculating block in order to calculate predicted values of the pixels Y { j(1) through the pixel 
Yjj(9). This predicted values calculating block is arranged by. for example, the below-mentioned 25 pixels (= 5 x 5). while 
a pixel Xij is set as a center: X ( j. 2 )(j.2)» X (i-2)G-1)» x (i-2)j« X p-2)Q+1). Xfl.2)rj+2)» Xfi- i)Q-2)» X (M)(M)' X («-i)i» X 0-1)G+1)- x (H)rj+2)i 

X iG-2)- X «G-1)' X U' X (iG+1)' X »G+2). X {i+1)G-2). X (i+1)(M)' X 0+1)j* X ('+1)G+1). X («+1)G+2). X (i+2)G-2). X G+2)G"I)* X (i+2)j. X (i+2)G+1)« 
X (i+2)G+2)- 

45 Concretely speaking, for instance, in Figure 7, to calculate the predicted values of the pixels Y33(1) to Y33(9) in the 
original image data surrounded by a rectangle, the predicted values calculating block is constructed by the following pix- 
els: X 11( X 12 . X 13 , X 14 , X 15 , X 2 i, X 22 , X 23 . X 24 , X 25 , X 31 , X 32 , X 33 , X 34 , X 35 , X 41 . X 42 , X^, X^. X^, X 51 , X^, Xsj, X 54 , 

x 55. 

The predicted values calculating block obtained in the block making unit for the predicted values calculation 42 is 
so supplied to the class classification adaptive processing circuit 43. 

Similar to the case of the class classifying block, the pixel number and the shape as to the predicted values calcu- 
lating block are not limited to the above-described examples. It should be noted that the total number of pixels for con- 
stituting the predicted values calculating block is preferably made larger than the total number of pixels for constituting 
the class classifying block. 

55 Also, when the above-explained block making process is carried out (similar to process operations other than block 
making), there are no corresponding pixels near the image frame of the image. In this case, for example, the process 
operation may be performed, assuming now that the same pixels as those for constituting the image frame are located 
outside this image frame. 
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The class classification adaptive processing circuit 43 is arranged by a class classifying unit 45, and an adaptive 
processing unit 46, and is designed to perform class classification adaptive processing operation. 

A class classification adaptive processing operation implies that an input signal is classified into several classes 
based on features thereof, and then, an adaptive process operation suitable for each of these classes is executed for 
the input signal of each of these classes. Roughly speaking, this class classification adaptive process operation is sub- 
divided into a class classification process operation and an adaptive process operation. 

Now, both the class classification process operation and the adaptive process operation will be simply explained. 

First, the class classification processing operation will now be explained. 

It is now assumed that, for instance, as indicated in Figure 9(A), a block (class classifying block) made of 2 x 2 pix- 
els is constructed of a pixel of interest, and three pixels located adjacent thereto, and each of these pixels is expressed 
by 1 bit (having any one of level "0" and level "1"). In this case, as indicated in Figure 9(B), a block of 4 pixels (2 x 2) 
may be classified into 16 (= (2^4), depending upon level distributions of the respective pixels. Such a pattern classifi- 
cation corresponds to the class classification process, which is performed in the class classifying unit 45. 

It should be noted that the class classification process operation may be carried out, taking account of also activi- 
ties (complexity of image), (strength of change) of an image (image within block). 

Normally, in this example, for instance, 8 bits or more are allocated to each of pixels. Also, in this embodiment, as 
previously explained, the class classifying block is arranged by 5 pixels. As a result, when the class classification proc- 
ess operation is performed with respect to such a class classifying block constituted by the original (8-bit) pixels, this 
block is classified into such a huge number of classes, i.e., (2 8 ) 5 . 

Therefore, according to this embodiment, as previously explained, the bit number of the pixel is reduced (reduced 
from 8 bits to 2 bits) in the level limiting unit 31 , so that the number of classes is deleted (1 024 (=(2 2 ) 5 ). 

Subsequently, the adaptive process operation will now be described. 

For instance, considering now that a predicted values E[y] of a pixel value "y" of the image is calculated by a linear 
primary coupling model. This linear primary coupling model is defined by pixel values X A , X 2 , — of several pixels located 
around this pixel value (will be referred to as "learning data" hereinafter, if required), and also linear coupling of prese- 
lected predictive coefficients W 1( W 2 . — . In this case, the predicted values E[y] may be expressed by the following for- 
mula: 



E[y] = + W 2 X 2 + — W 25 X 25 +W0 



(1). 



where symbol "WO" is an offset coefficient which is added so as to express E[y] by 8 bits, because the original 8-bit data 
"Xi" has been converted into the 2-bit data. 

Thus, to generalize this formula, when a matrix W made of a set of the predictive coefficient w, a matrix X made of 
a set of the learning data, and a matrix Y* made of a set of the predicted values E[y] are defined by [formula 1], 
the following observation equation can be satisfied: 



40 



x= 



X] 1 ""* Xyfl 

^21 ^22 X^fl 
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55 



XW = Y' 



(2). 



Then, considering now that the predicted values E[y] approximated to the pixel value y of the original image data is 
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obtained by applying the minimum squaring method to this observation equation. In this case, when a matrix Y made 
of a set of pixel values of the original image data (will be referred to as "teacher data" hereinafter, if necessary), and 
another matrix E made of a set of remainder of the predicted values E[y] with respect to the pixel value y of the image 
are defined by [formula 2]. the below-mentioned remainder equation may be satisfied from the formula (2): 



E = 



JO 



15 



XW = Y + E ... (3). 



In this case, a predictive coefficient Wi used to calculate the predicted values E[y] approximated to the pixel value 
25 y of the original image data may be calculated by minimizing the square error [formula 3]. 

m 

,2 . (3) 



30 



7>> 

M 

As a consequence, the above-described square error is differentiated by the predict coefficient Wi becomes 0 
namely the predictive coefficient Wi capable of satisfying the following formula becomes an optimum value used to cal- 
culate the predicted values E[y] approximated to the pixel value "y" of the original image data. 



35 [formula 4] 

e ia^. + e ^. + - + a^ =0( ' =1 - 2 n) 



ae, ^ ee JSm 2 (4) . 



40 



Thus, firstly, since the formula (3) is differentiated by the predictive coefficient Wi, the below-mentioned formula can 
be satisfied: 



[formula 5] 



dw f ,1, dw 2 ,2 ' 'dw n ' n ' v 



so Based on the formulae (4) and (5), formula (6) may be obtained: 
[formula 6] 

£ e,*,,=0. £ e,x i2 =0, ... £ e,*„ = 0 (6). 
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Furthermore, considering the relationship among the learning data "x", the predictive coefficient "w", the teacher 
data "y", and the remainder "e" contained in the remainder equation defined in the formula (3), it is possible to obtain 
the following normal equation from the formula (6): 

[formula 7] 



m 



m 



(E 



/-1 



(E***/M +(E X M W 2+ + (EW>n = £^ 



M 
m 



(E Wll) *1 + (E X lnX£ W 2 + - + (E % " (E 

/-I M 



/«1 
m 

E 

M 
m 

E 

/-1 



E 

M 
m 

E 



. . . (7). 



The normal equations defined in the formula (7) may be established, the number of which is the same as that of 
the predictive coefficients w to be calculated. As a result, an optimum predictive coefficient w can be obtained by solving 
the formula (7). It should be noted that to solve the formula (7), for instance, the sweep-out method (Gauss- Jordan's 
erasing method) may be applied. 

As previously described, the adaptive processing operations is carried out in such a manner that the optimum pre- 
dictive coefficient w, and further, the predicted values E[y] approximated to the pixel value y of the original image data 
is calculated based on the formula (1) by using this predictive coefficient w. This adaptive processing operation is per- 
formed in the adaptive processing unit 46. 

It should be noted that this adaptive processing operation is different from the interpolation processing operation. 
That is, in this adaptive processing operation, a component is reproduced which is contained in an original image data, 
but is not contained in a thinned image data. In other words, the adaptive processing operation is identical to the inter- 
polation processing operation with employment of a so- called "interpolation filter", while considering only to the formula 
(1). However, since the predictive coefficient w corresponding to the tap coefficient of this interpolation filter is calcu- 
lated by using the teacher data "y", namely the learning system, the component contained in the original image data 
can be reproduced. In view of this technical point, the adaptive processing operation may be referred to as a process 
operation with an image forming effect. 

Referring now to a flow chart shown in Figure 10, the operation of the local decoder 22 of Figure 8 further 
explained. 

First, in the local decoder 22, at a step S21 , the corrected data derived from the compressing unit 21 is processed 
to make blocks. In other words, in the block making unit for class classification 41 , the correction data is subdivided into 
a class classifying block made of 5 pixels centered about the noted corrected data, which will be then supplied to the 
class classification adaptive processing circuit 43. In the block making unit for the predicted values calculation 42, the 
corrected data is subdivided into a predicted values calculating block made of 5 x 5 pixels centered about the noted cor- 
rected data, which will be then supplied to the class classification adaptive processing circuit 43. 

As previously explained, in addition to the class classifying block and the predicted values calculating block, the 
original image data is supplied to the class classification adaptive processing circuit 43. The class classifying block is 
supplied to the class classifying unit 45, and the prediction calculating block and the original image data are supplied to 
the adaptive processing unit 46. 

At a step S22, the class classifying unit 45 performs the class classification processing operation with respect to 
the class classifying block. Namely, the class classifying unit 45 detects a state of distribution of each of the pixel levels 
in the block, and then judges to which dass, this class classifying block belongs. This class judging result is supplied as 
class information to the adaptive processing unit 46. 

It should be understood that in this embodiment, since the class classification processing operation is performed 
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with respect to the class classifying block constructed of 5 pixels expressed by 2 bits, each of the dass classifying 
blocks is classified into any one of 1024 classes (= (2 2 ) 5 ). 

Then the process operation is advanced to a step S23. at which the adaptive processing operation is carried out 
for each class based on the class information supplied from the class classifying unit 45 to the adaptive processing unrt 
46. As a result, both the predicted values and the predicted coefficients for each class of 1 frame of the ong.nal image 

^ThaVfe SSng to this embodiment, for instance. 25 x 9 predictive coefficients for each dass are calculated using 
the correded data and the original image data for 1 frame, in such a case that an attention is made of one certain cor- 
redion data predided values as to a total of 5 pixels, namely a pixel corresponding to this corred.on data of interest 
and also 4 pixels adjacent to this pixel, are calculated by executing the adaptive processing operation with employment 
of the 25 x 9 predidive coefficients and the predided values calculating block made of 5 x 5 pixels where the correction 

data of interest in centered in response to dass information. ,«, Mi4 ^„„ 

In concrete terms for example, it is now assumed that class information C is outputted from the dass classifying 
unit 45 and this class information C is related to a class classifying block constituted by 5 corredion data X 23 . X 32 . X 33 , 
X 34 X*,. where corredion data X 33 shown in Figure 7 is centered. Also, it is now assumed that as the predicted values 
calculating block corresponding to the class dassifying block, a predided values calculating bio* is outputted from the 
oredided values calculating block making unit 42. This predidion calculating block is arranged by X u . X 12 , X 13 . x 14 . 
X 15 . X 21 . X 22 . X 23 . X 24 . X 25 . X 31 . x 32 . X 33 . X34 . X 35 . X 41 . X 42 . X 43 . X44 . X45. X 5 ^X 52 . X53 . x 54. X 55 . ^ere^on 
date xJ, is centered. First while the correction data for constituting this predided values calculating block s set to the 
learning data, and the pixel values ¥33 (1) to Y 33 (9) of the 3 x 3 pixels (a portion surrounded by a redangle in Figure 
7) where the corrected data X 33 is centered in the original image data are set to the teacher data, the normal equation 
indicated in the formula (7) may be established. 

Moreover for example, for 1 frame, the normal equation is similarly established as to other predided values calcu- 
lating blocks corresponding to other class classifying blocks which are classified into the dass information C. When the 
normal equations are established by which a predidive coefficient W,(k) to a predictive coeffident W 25 (k) used to cal- 
culate a predided values E[Y 33 (k)] of a pixel value Y 33 (k) (k = 1 . 2. -. 9) can be calculated, these normal «,uatons 
are solved so that an optimum predictive coefficient Wl (k) to an optimum predictive coefficient w 5 (k) are calculated 
which are suitable for calculating the predided values [Y 33 (k)] of the pixel value Y 33 (k) as to the class information C. 
The above-described predidive coefficients "w" require 26, since 25 pieces of the learning data for obtaining one pre- 
dided values are used and further, one offset coefficient is required in this embodiment. Also, the process operations 
for establishing the normal equations are executed at step S23 until the above-described number of normal equ^ons 
can be obtained. The above processing is carried out for each dass. 25 x 9 predictive coefficients are calculated. Then, 
in accordance with the below-mentioned formula corresponding to the formula (1). the predided values EIY^M 's 
obtained using 25 x 9 predidive coeffidents corresponding to class information and the 25 pixels in the predided value 
calculating block: 

E[Y 33 (k)l = w , (k)X u + w 2 (k)X , 2 + w 3 {k)X 13 + w 4 (k)X 14 + w 5 (k)X 1S + w 6 (k)X 21 
+ w 7 (k)X 22 + w 8 (k)X 23 + w 9 (k)X 24 +w 10 (k)X2 S +w 11 (k)X 31 
+ W 12 (k)X 32 + W , 3 (k)X 33 + W 14 (k)X 34 + w 15 (k)X as + w 16 (k)X 41 (8). 
+ w 17 (k)X 42 + w 18 (k)X 43 + w 19 (k)X 44 + w 20(^X45 + « 21 (k)X 51 

+ W 22 (k)X 5 2 + W 23 (k)X 53 + W 24(^X54 + W 35(^X55 + w 0 (k) 

In step S23 after 25 x 9 predictive coefficients for each class are calculated. 3x3 predided values are calculated 
in units of 3 x 3 pixels centered about the noted correded data. Thereafter, in step S24. the 25 x 9 predictive coefficients 
for each class are provided to determining 24. and predided values are provided to error calculator 23 for each unit of 
3x3 pixels. Step S21 is then returned to and the same process is repeated thereafter, for example, for each one frame. 

Next Figure 1 1 illustrates an example of an arrangement of the error calculator 23 of Figure 3. 

To the blocking, the original image data, is supplied. In this case, the blocking unit 51 processes the input image 
data to make 9 pixel blocks in correspondence with the predided values outputted from the local decoder 22. Trie 
resultant image blocks (e.g.. blocks of 3 x 3 pixels as surrounded by a rectangle in Figure 7) construded of 3 x 3 pixe s 
are supplied from the block making unit 51 to a square error calculating unrt 52. As previously explained, in addition to 
the blocks supplied from the block making unit 51 , the predided values derived from the local decoder 22 is supplied m 
unit of 9 pixels (block unit of 3 x 3 pixels) to the square enor calculating unit 52. This square error calculating unrt 52 
calculates a square error as a prediction error of this predided values with resped to the original image data, and then 
supplies this calculated square error to an integrator 55. t „„ 

That is to say, the square error calculating unit 52 includes calculators 53 and 54. The calculator 53 subtracts the 
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corresponding predicted values from each of the block-processed image data outputted from the block making unrt 51 , 
and then supplies this subtraction value to the calculator 54. The calculator 54 squares the output (a difference between 
original image data and predicted values thereof) of the calculator 53, and supplies the squared value to the integrator 

55. 

Upon receipt of the square error from the square error calculating unit 52. the integrator 55 reads a stored value of 
a memory 56 adds this stored value to the square error, and again supplies the added value to the memory 56 so as 
to be stored therein. Then, the aboveKtescribed operation is repeated by the integrator 55. so that a multiplied value of 
the square error (error distribution). Furthermore, when the integration for a preselected amount (for instance, amount 
for 1 frame) of square errors is completed by the integrator 55. this integrator 55 reads out from this integrated value 
from the memory 56. and then supplies this integrated value as the error information to the determining unit 24. While 
the stored values of the memory 56 are cleared every time the process operation as to 1 frame is completed, the output 
values of the integrator 55 stored into this memory 56. 

Referring now to a flow chart shown in Figure 12. the operation of the error calculator 23 is further explained. First, 
at a step S31 in the error calculator 23. the stored value of the memory 56 is cleared to become, for example, "0". Then, 
the process operation is advanced to a step S32, at which the image data is block-processed in the above-described 
manner by the blocking unit 51 , and the resulting block is supplied to the square error calculating unit 52. In the square 
error calculating unit 52. at a step S33. a calculation is made of the square error between the original image data, which 
constitutes the block supplied from the blocking unit 51 . and the predicted values supplied from the local decoder 22. 

In other words at a step S33. in the calculator 53, the corresponding predication value is subtracted from each of 
the image data which has been block-processed and supplied by the blocking unit 51 . and then the subtraction value 
is furnished to the calculator 54. Further, at a step S33. the output from the calculator 53 is squared by the calculator 
54 and the squared value is supplied to the integrator 55. 

' Upon receipt of the square error supplied from the square error calculating unit 52. the integrator 55 reads out the 
stored value of the memory 56. and integrates the value of the square error by adding this read stored value to the 
square error at a step S34. The integrated value of the square error integrated in the integrator 55 is supplied to the 
memory 56, and is overwritten on the preceding stored value so as to be stored. 

Then at a step S35. in the integrator 55. a judgment is made as to whether or not the integrations of the square 
errors as to a preselected amount, for instance, one frame data are completed. At the step S35. when it is so judged 
that the integrations of the square errors for 1 frame data are not accomplished, the process operation is returned to 
the step S32 at which the process operation defined from the step S32 is again repeated. At the step S35. when it is 
so judged that the multiplications of the square errors for 1 frame data are accomplished, the process operation is 
advanced to a step S36. At this step S36. the integrator 55 reads out the multiplied value of the square errors for 1 frame 
data, stored in the memory 56, and then outputs this multiplied value as the error information to the determining unit 24. 
Then, the process operation is returned to the step S31 , at which the process operations defined from the step S31 are 

35 repeated. .. 

As a consequence in the error calculator 23, assuming now that the original image data is Yij(k). and the predicted 
values thereof processed from the corrected data in the local decoder 22 is E[Yij(k)], the error information Q may be 
calculated by executing a calculation in accordance with the following formula: 
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S(Yij (^-[Y^k)]) 2 , 



where symbol "X" implies a summation of 1 frame data. 

Next. Figure 13 represents an example of an arrangement of the determining unit 24 of Figure 3. 

A predictive coefficient memory 61 stores therein the predictive coefficients supplied from the local decoder 22. A 
45 corrected data memory 62 stores therein the corrected data supplied from the compressing unit 21 . 

It should be noted that when the compression data is newly corrected, and therefore the newly corrected data is 
supplied, the corrected data memory 62 stores therein the newly corrected data instead of the previously stored cor- 
rected data (namely, previous corrected data). Also, at such time that such a corrected data has been updated by the 
newly corrected data, a set of new predictive coefficients for each class corresponding to this newly corrected data is 
so outputted from the local decoder 22. Also, in the predictive coefficient memory 61 , in such a case that a new predictive 
coefficient for each class is supplied thereto in the above manner, this new predictive coefficient is stored instead of the 
previously stored predictive coefficient for each class (namely, preceding predictive coefficient for each class). 

The error information memory 63 stores therein the error information supplied from the error calculator 23. It should 
also be noted that the error information memory 63 stores therein the error information which has been supplied from 
55 the error calculator 23 in the previous case, in addition to the presently supplied error information (even when the new 
error information is supplied, the previously stored error information is saved until the further new error information is 
supplied). Also, the content of the error information memory 63 is cleared every time the process operation for a new 
frame is commenced. 
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A comparator 64 compares a predetermined threshold value V with the presently supplied error information stored 
in the error information memory 63. and further, may compare the presently supplied error information with the previ- 
ously supplied error information, if required. A comparison result obtained from the comparator 64 is supplied to a con- 
troller 65. 

5 The controller 65 judges whether or not the corrected data stored in the corrected data memory 62 is correctly (opti- 

mally) equal to the coded result of the original image data based on the comparison result obtained from the compara- 
tor 64. When it is recognized (judged) that the corrected data is not optimally equal to the coded result, the controller 
65 supplies a control signal for requesting an output of new corrected data to the compressing unit 21 (correcting unit 
21) (Figure 5). To the contrary, when the controller 65 recognizes that the corrected data stored in the corrected data 

w memory 62 is optimally equal to the coded result of the image, the predictive coefficient for each class stored in the pre- 
dictive coefficient memory 61 is read out to be outputted to the multiplexor 25, and also the corrected data stored in the 
corrected data memory 62 is read to be outputted as the optimum corrected data to the multiplexor 25. Furthermore, in 
this case, the controller 65 outputs a control signal to the compressing unit 21 , and this control signal indicates such a 
message that the coding operation for 1 frame image is accomplished. As a result as previously explained, the control- 

15 ler 65 causes the compressing unit 21 to commence the process operation for the next frame. 

Next, operations of the determining unit 24 is further described with reference to Figure 14. At a first step S41. in 
the determining unit 24, the comparator 64 judges as to whether or not the error information is received from the error 
calculator 23. When the comparator 64 judges that the error information is not received, the process operation is 
returned to the step S41. On the other hand, when the comparator 64 judges that the error information is received, 

20 namely when the enor information is stored in the error information memory 63. the process operation is advanced to 
a step S42. At this step S42, the comparator 64 compares a predetermined threshold value V with the presently stored 
error information (present error information) so as to judge that any one of these values is larger. 

At this step S42. when it is so judged that the present error information is larger than or equal to a predetermined 
threshold value V. the comparator 64 reads out the preceding error information stored in the error information memory 

25 63. Then, at a step S43, the comparator 64 compares the preceding error information with the present error information 
so as to judge whether or not the preceding error information is larger than the present error information. 

In such a case that the process operation for 1 frame image is commenced, and the error information is first sup- 
plied, since the preceding error information is not stored into the error information memory 63, in this case, the process 
operations defined after the step S43 will not be performed in the determining unit 24. The controller 65 outputs a con- 

30 trol signal for controlling the correcting circuit 32 (Figure 5) in order to output a predetermined initial address. 

When it is so judged at the step S43 that the present error information is less than or equal to the preceding error 
information, namely, when the compression data is corrected to thereby reduce the error information, the process oper- 
ation is advanced to a step S44. At this step S44, the controller 65 outputs to the correcting circuit 32, such a control 
signal for instructing that the correction value A is changed in a similar manner to that of the preceding case. Then, the 

35 process operation is returned to the step S41 . To the contrary, when it is so judged at the step S43 that the present error 
information is larger than the preceding error information, namely when the error information is increased by correcting 
the compression data, the process operation is advanced to a step S45. At this step S45, the controller 65 outputs to 
the correcting circuit 32. such a control signal for instructing that the correction value A is changed in a manner opposite 
to that of the preceding case. Then, the process operation is returned to the step S41 . 

40 It should also be noted that when the continuously reduced error information is increased at certain timing, the con- 
troller 65 outputs such a control signal for instructing that the correction value A is decreased by, for example, 1/2. and 
is changed in a manner opposite to that of the previous case. 

Then, since the process operations defined from the step S41 to the step S45 are repeated, the error information 
is decreased. As a result, in the case that it is so judged at the step S42 that the present error information is smaller 

45 than a predetermined threshold value V. the process operation is advanced to a step S46. At this step S46, the control 
circuit 64 reads out the predictive coefficient for each class stored in the predictive coefficient memory 61 , and also 
reads out the corrected data of 1 frame stored in the corrected data memory 62. Then, these optimum compressed data 
and predictive coefficients for each class are supplied to the multiplexor 25. and the process operation is ended. 

Thereafter, the process operations are again repeated in accordance with a flow chart shown in Figure 14, while 

so waiting for the supply of the error information about the next frame. 

It should also be noted that in the correcting circuit 32. as to the correction of the compression data, ail of the com- 
pression data for 1 frame may be corrected, and only a portion of this compression data for 1 frame may be corrected. 
When only a portion of the compression data is carried out for instance, the pixels capable of giving a strong influence 
to the error information is detected by the controller 65, and only the compression data about such pixels may be cor- 

55 rected. The pixels capable of giving the strong influence to the error information may be detected by way of the following 
manner, for instance. That is. first of ail, the process operation is carried out by directly utilizing the level-controlled com- 
pression data as to the remaining pixels after thinning, so that this enor information is acquired. Then, such a control 
signal is supplied from the controller 65 to the correcting circuit 32, by which executes a process operation for correcting 
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the compression data as to the remaining pixels after thinning by the same correction value A every one pixel. The 
resulting error information is compared with such an error information that is obtained when the compression data is 
directly utilized. Then, a pixel about the error information where a comparison difference becomes larger than, or equal 
to a predetermined value may be detected as the pixel capable of giving the strong influence to the error information. 

As previously described, the correcting operation of the compression data is repeated until the error information is 
reduced, or decreased smaller than a preselected threshold value V. The corrected data obtained when the error infor- 
mation becomes smaller than the preselected threshold value V is outputted as the coded result of the image. Accord- 
ingly, in the receiving apparatus 4 (Figure 1), it is possible to produce the decoded image (decoded image with high 
image quality) identical to (or, substantially identical to) the original image data from the corrected data (optimum cor- 
rected data) where the pixel values of the pixels for constituting the thinned image are made as the most proper values 
used to recover the original image data. 

Since the image is compressed by way of the thinning process operation, and also by the level limiting process 
operation and the class classification adaptive process operation, it is possible to obtain the coded data with the very 
high compression rate. It should be noted that the above-explained coding process operation executed in the transmit- 
ting apparatus 1 may be referred to as a "combined coding process operation", since the compression process opera- 
tion by the thinning operation is organically combined with the class classification adaptive process operation so as to 
realize the high efficiency compression. 

Referring now to Figure 15, a decoder for use with the first embodiment of the invention is now described. Figure 
15 illustrates an example of an arrangement of the receiving apparatus 4 shown in Figure 1. 

In a receiving/reproducing unit 71 , coded data recorded on the recording medium 2 is reproduced, or coded data 
transmitted via the transmission path 3 is received, and is supplied to a separating unit 72. In the separating unit 72, the 
coded data is separated into corrected data and a predicted coefficients for each class. The corrected data is supplied 
to a blocking unit for class classifying 73 and a blocking unit for predicted value calculation 77, whereas the predictive 
coefficients for each class are supplied to a predicting unit 76 and then are stored in a memory (not shown) for example. 

It should be understood that the blocking unit for class classifying 73, the class classifying unit 75, or the blocking 
unit for predicted value calculation 77 are arranged similar to the class classification block circuit 41 , the class classify- 
ing unit 45, or the predicted values calculation block making unit 42, shown in Figure 8. As a result, in these blocks, a 
similar process operation to that of Figure 8 is carried out. As a result a predicted values calculating block is outputted 
from the blocking unit for predicted value calculation 77, or class information is outputted from the class classifying unit 
75. These predicted values calculation block and class information are supplied to the predicting unit 76. 

In the predicting unit 76, 25 x 9 predictive coefficients are read out from the memory (not shown) in response to 
class information, and a calculation is made of a 3 x 3 predicted values in accordance with the formula (1) by using the 
read predictive coefficient corresponding to the class information, and also the 5 x 5 correction data for constituting the 
predicted values calculation block supplied from the blocking unit for predicted value calculation 77. Then, an image for 
1 frame constituted by such a predicted values is outputted as a decoded image. As previously explained, this decoded 
image is substantially equal to the original image. 

It should also be noted that even when the receiving apparatus 4 as shown in Figure 15 is not employed at the 
reception end, the normal interpolation is carried out without using the predictive coefficient by such an apparatus for 
decoding a thinned image by way of a simple interpolation, so that it is possible to obtain a decoded image. In this case, 
an image quality (resolution) of this resultant decoded image is deteriorated. 

Second Embodiment 

In the first embodiment of the invention, the predictive coefficient is obtained in the local decoder 22 of Figure 3, 
and then the predicted values is calculated by using this predictive coefficient. Alternatively, the respective predicted 
values may be calculated without obtaining the predictive coefficient in the local decoder 22. 

In further detail, a second embodiment of the invention is described with reference to the transmitting apparatus of 
Figure 28, the compressing unit of Figure 5, the local decoder of Figure 16. the error calculator of Figure 1 1 , the deter- 
mining unit of Figure 13 and the learning device for predictive coefficients of Figure 17. The receiving apparatus for use 
with this second embodiment is illustrated in Figure 15. Except as otherwise noted, the compressing unit of Figure 5, 
the error calculator of Figure 1 1 , the determining unit of Figure 1 3 and the receiving apparatus of Figure 1 5 operate as 
previously described with respect to the first embodiment of the invention. 

With reference now to Figure 28, the transmitting apparatus of the second embodiment differs from that of Figure 
3 in that the local decoder 22' of Figure 28 operates differently from that of local decoder 22 of Figure 3. as further 
explained below. 

Referring now to Figure 16, Figure 16 illustrates another embodiment of the local decoder 22 of Figure 3. It should 
be understood that the same reference numerals shown in Figure 8 will be employed as those for indicating the corre- 
sponding circuit portions. That is. instead of the adaptive processing circuit 46, a predictive coefficient ROM 81 and a 
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predicting unit 82 are employed in the local decoder 22' of Fig 16. Otherwise, other circuit arrangements thereof are 
similar to those of Figure 8. 

The predictive coefficient ROM 81 stores therein predictive coefficients with respect to classes, which have been 
obtained by way of learning (will be discussed later). Upon receipt of class information outputted from the class classi- 
5 tying unit 45, the predictive coefficient stored at an address corresponding to this class information is read out from this 
predictive coefficient ROM 81 and then is supplied to the predicting unit 82. 

In the predicting unit 82. a calculation is made of a linear equation indicated in the formula (1) (concretely speaking, 
for example, formula (8)) by employing the predicted values calculating block derived from the block making unit for the 
predicted values calculation 42, and also the predictive coefficient ROM 81. As a result, a predicted values of the orig- 
w inal image data is calculated. 

As a result, in accordance with the class classification adaptive processing circuit 43 shown in Figure 16, this pre- 
dicted values can be calculated without employing the original images data. 25 x 9 predictive coefficients for each class 
stored in the predictive coefficients ROM 81 are outputted to determining unit 24 in the above embodiment 

As indicated in Figure 16, when the local decoder 22' is arranged, the receiving apparatus 4 shown in Figure 15 
is may be arranged in such a manner that the post stage of the receiving/reproducing apparatus 71 is constituted similar 
to the class classification processing circuit 43 of Figure 16. 

With reference now to Figure 29, the operation of the local decoder 22' of Figure 16 is explained in further detail. 
First, in the local decoder 22'. at a step S21 . the corrected data derived from the compressing unit 21 is processed to 
make blocks. In other words, in the block making unit for class classification 41 , the correction data is subdivided into a 
20 class classifying block made of 5 pixels centered about the noted corrected data, which will be then supplied to the class 
classification adaptive processing circuit 43. In the block making unit for the predicted value calculation 42, the cor- 
rected data is subdivided into a predicted values calculating block made of 5 x 5 pixels centered about the noted cor- 
rected data, which will be then supplied to the class classification adaptive processing circuit 43. 

As previously explained, the class classifying block is supplied to the class classifying unit 45, and the prediction 
25 calculating block is supplied to the predicting unit 82. 

At a step S22, the class classifying unit 45 performs the class classification processing operation with respect to 
the class classifying block. Namely, the class classifying unit 45 detects a state of distribution of each of the pixel levels 
in the block, and then judges to which class, this class classifying block belongs. This class judging result is supplied as 
class information to the predictive coefficient ROM 81 . 
30 It should be understood that in this embodiment, since the class classification processing operation is performed 

with respect to the class classifying block constructed of 5 pixels expressed by 2 bits, each of the class classifying 
blocks is classified into any one of 1024 classes (= (2 2 ) 5 ). 

Then, the process operation is advanced to a step S23', at which predictive coefficients corresponding to each 
class are read. In step 24' an adaptive process is executed by predicting unit 82 to calculate predictive values. In step 
35 S25'. the predictive coefficients for each class are output by predictive coefficient ROM 81 , while the predictive values 
are output by predicting unit 82. Step S21 is then returned to and the same process is repeated thereafter, for example, 
for each one frame. 

Next, Figure 1 7 illustrates a structural example of an image processing apparatus for executing a learning operation 
so as to obtain the predictive coefficients stored in the predictive coefficient ROM 81 shown in Figure 16. 

40 To a block making unit for learning 91 and a block making unit for teaching 92, image data for a learning purpose 
(learning image) (accordingly, image data before being thinned) is supplied which is used to obtain predictive coeffi- 
cients applicable to any images. 

The learning block making unit for learning 91 extracts, for instance, 25 pixels (5x5 pixels) of a positional relation- 
ship indicated by symbol " • " centered about the noted pixel in Figure 7, from the inputted image data, and thereafter 

as supplies a block constituted by these 25 pixels as a learning block to a level limiting unit 93. The level limiting circuit 93 
limits the level of the inputted pixel data, and outputs the level-limited pixel data to a class classifying unit 94 and a learn- 
ing data memory 96. 

Also, in the block making unit for teaching 92, for example, a block constituted by 9 pixels (3x3 pixels) centered 
about the noted pixel is produced from the input image data, and then a block constituted by these 9 pixels is supplied 
so as a teacher block to a teacher data memory 98. 

It should also be noted that when the learning block constructed of, for example, the 25 pixels located in the posi- 
tional relationship indicated by symbol " • " shown in Figure 7 in the learning block making unit for learning 91 . the 
teacher block of 3 x 3 pixels surrounded by a rectangle shown in Figure 7 is produced from the block making unit for 
teaching 92. 

55 The class classifying unit 93 extracts central 9 pixels (3x3 pixels) from the 25 pixels for constituting the learning 
block, and then executes a class classification with respect to the block made of these 9 pixels. The level limiting circuit 
93 limits the level of the inputted pixel data, and outputs the level-limited pixel data to a class classifying unit 94 and a 
learning data memory 96. The resulting class information is supplied via a terminal "a" of a switch 95 to the learning 
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data memory 96 and the teacher data memory 98. 

In the learning data memory 96, or the teacher data memory 98. the learning block outputted from the level limiting 
circuit 93. or the teacher block outputted from the block making unit for teaching 92 is stored at an address (AD) corre- 
sponding to the class information supplied thereto. 

As a result, assuming now that, for example, the block constituted by 5 x 5 pixels shown by symbol " • " in Figure 7 
is stored as the learning block at a certain address of the learning data block 96, the block constructed of 3 x 3 pixels 
indicated in this drawing and surrounded by the rectangle is stored as the teacher block at the same address as the 
above- described address. 

Subsequently, a similar process operation is repeated as to all of the prepared learning images, so that the learning 
block and the teacher block are stored at the same addresses in the learning data memory 96 and the teacher data 
memory 98. The teacher block is arranged by 9 pixels, in which the predicted values is calculated in the local decoder 
22 of Figure 16 by employing the predicted values calculating block constituted by 25 corrected data having the same 
positional relationship as that of the 25 pixels for constituting this learning block. 

Since a plurality of information is stored at the same addresses in the learning data memory 96 and the teacher 
data memory 98, a plurality of learning blocks and a plurality of teacher blocks can be stored at the same addresses. 

When the learning blocks and the teacher blocks as to all of the learning images are stored into the learning data 
memory 96 and the teacher data 98, the switch 95 which has selected the terminal "a" is changes this terminal into 
another terminal "b*\ so that an output of a counter 97 is supplied as an address to the learning data memory 96 and 
the teacher data memory 98. The counter 97 counts a predetermined clock to output a count value thereof, whereas in 
the learning data memory 96. or the teacher data memory 98, either the learning block or the teacher block stored at 
an address corresponding to this count value is read out to be supplied to a calculating unit 99. 

As a result, to the calculating unit 99, a set of learning blocks, and also a set of teacher blocks of the dass corre- 
sponding to the count value of the counter 97 are supplied. 

Upon receipt of a set of learning blocks and also a set of teacher blocks as to a certain class, the calculating unit 
99 calculates a predictive coefficient capable of minimizing an error by way of the minimum square method by using 
these block sets. 

In other words, for instance, assuming now that pixel values of pixels for constituting a learning block are X n X 2 , X 3 , 
— , and also predictive coefficients to be required are w 1t w 2 , w 3 . — , the predictive coefficients w-, , w 2 . w 3 . — . must sat- 
isfy the following formula in order to obtain a pixel value y of a certain pixel for constituting a teacher block by way of 
a linear equation of these values: 

y = w 1 x 1 + w 2 x 2 + w 3 x 3 + — + w 0 

As a consequence, the predictive coefficients w 1 . w 2 . w 3 , — , w 0 may be calculated in the calculating unit 99 in such 
a way that the normal equation indicated in the above-described formula (7) is established and solved, while these pre- 
dictive coefficients minimize a square error of the predicted values w n x 1 + w 2 x 2 + w 3 x 3 + — + w 0 with respect to a true 
value y from both the learning block in the same class and the teacher block corresponding thereto. Therefore. 25 x 9 
predictive coefficients for each class are calculated by carrying out the above process for each class. 

The predictive coefficients with respect to the respective classes, which are calculated in the calculating unit 99. 
are supplied to a memory 100. Into the memory 100. the count value is supplied from the counter 97 in addition to the 
predictive coefficients derived from the calculating unit 99. As a result, in the memory 100. the predictive coefficients 
derived from the calculating unit 99 are stored at the addresses corresponding to the count values outputted from the 
counter 97. 

As described above, the optimum 25 x 9 predictive coefficients used to predict the 3 x 3 pixels of the block in this 
class are stored at the addresses corresponding to the respective classes in the memory 100. 

The predictive coefficients for each class stored in the memory 100 in the above-described manner are stored in 
the predictive coefficient ROM 81 of Figure 16. In the second embodiment, since predictive coefficients for each class 
are not calculated in the local decoder 22' of Figure 16. it is possible to raise processing speed. 

As indicated in Figure 16, with the configuration of the local decoder 22'. the receiving apparatus 4 shown in Figure 
1 5 may be arranged in such a manner that the post stage of the receiving/reproducing apparatus 71 is constituted sim- 
ilar to the class classification processing circuit 43 of Figure 16. 

Third Embodiment 

In the first embodiment of the invention, the predictive coefficient is obtained in the local decoder 22 of Figure 3, 
and then the predicted values is calculated by using this predictive coefficient. Alternatively, the respective predictive 
coefficients need not be calculated, but instead may be omitted from transmission and/or recording and then calculated 
within a receiving apparatus. 
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in further detail, a third embodiment of the invention is described wrth reference to thatnnsrm ^ a * s JJ" 
ure 30 the compressing unit of Figure 5. the local decoder of Figure 32. the error calculator of F.gure 1 1 aid the deter- 
mining unrt FtourTs . 7e receiving apparatus for use with this third embodiment is illustrated in Figure 36. Except 
™oSse nS the compressing unit of Figure 5 and the error ca.cu.ator of Figure 1 1 operate as previously 
described with respect to the first embodiment of the invention. 

With reference now to Figure 30. the transmitting apparatus of the third embodiment differs from thatof Figure 3jn 
that toXcTdecoder 22" of Figure 28 operates differently from that of .oca. decoder 22 of Figure 3. as further explamed 
betw Fu?herm ore . the determining unit 24" of Figure 30 does not output predictive coeftaents for each class, and 

therefore, there is no need for a multiplexor 25 as in Figures 3 and 28. ««,-.•,• 

With reference now to Figure 31. the operation of the transmitting apparatus of Figure 30 « ^'*"^f *° 
image data is supplied to the compressing unit 21 . the compressing unit 21 f rat corr^esses this .rrrage date.^ a step 
St while thinning the image data (namely, extracting plural pixels from a large number of pixels). At a step S2. levels 
ofthTex^ 

SoutittS It? the local decoder 22" and the determining unit 24 without any correct™ in the beginning. In the loca^ 
decoSel S" at a s £Ts3. the corrected data derived from the compressing unit 21 is locally decode* This corrected 
da£ t to Jucha compression data that, as previously explained, the image data is simply th.nned and also level- 

"^^StXS^ values are calculated. The predicted values calculated in the local decoder 22" are 

^Tn^Z^lS*** of the predicted values outputted from the local decoder 22" is identical to the 
decoded imaae obtained on the side of the receiving apparatus 4 (Figure 1). 

CenTepredicted values of me original image dato are rece^ 
23 aTa step S4. me error ca.cu.ator 23 ca.cu.ates the prediction error of the predicted va ues derived from the local 
decoder 2? with respect to the original image data, and supplies this prediction error as the error -"formation to toe 
d«rnguntt24- When the erro, information is received from the error calculator 23. the determining unrt 24 judges 
at a sTep S5 as to whether or not the corrected data oulputted from the compressing unit 21 is correctly equal to the 

^Sw^s 6 ^ 

a predetermined threshold value V. At the step S5. when rt is so judged that the error mformatjon is not less than the 
VSSSS^Ztii value V. a recognition is made that the corrected data outputted from the compressing unit 
2lt noS to the coded data of the original image. Then, the process operation is advanced to a step S6 a which 
toe deSS unit 24' controls the compressing unit 21 so as to correct the compression data. The compressmg unrt 
21 v^esacSon amount (namely, correction value "A" will bediscussed later) under control of the detenr,,ning unit 
24'i^order to correct the data. The resultant corrected data is outputted to the local decoder 22" and the determining 
unit 24 Thin, toe pVocess operation is returned to the previous step S3, and a similar process operabon will now be 

TJS.'S? rind, at the step S5. when rt is so judged that toe error information is .ess than toe 
threshold value V. a recognition that toe corrected data oulputted from the compressmg unrt 21 ,s conertye^al to 
the coSed result of the original image data. The determining unrt 24 outputs as optmum compressed data when the 
error information less than the predetermined threshold value "e". Then, the process is ended. 

A^™ous"y gained, since the corrected data produced by correcting the compresston data, such a con*bon 
that toe er™ informSon becomes less than a preselected threshold value V is used as toe coded resu"oftoeo^l 
image data, it is possible to obtain such an image substantially identical to toe original .mage data based on this cor- 
rected data on the side of the receiving apparatus. „. 

Referring now to Figure 32. a block diagram of the local decoder 22" is shown In contrast to ^oca'd^er 22 
of Figure 16 (of the second embodiment) toe local decoder 22" does not output from predictive coefficients ROM 81 
predictive coefficients for each class. , . . . . fll _ a , 

P With reference now to Figure 33. the operation of toe local decoder 22" of F.gure 32 ,s «*2^^ 
decoder 22". at a step S21 . the corrected data derived from the compressing unrt 21 'SP"* 6 ^ to make flocks In 
, otheVwords in the block making unrt for class classification 41 , toe correction data is subdivided into a class classing 
Sock n^de of 5 pixels centered about the noted corrected data, which will be then supplied to the 
adaptive processing circuit 43. In the block making unit for thepredicted value ^ *? °^22 2S tE£ 

dLed il a predicted values calculating block made of 5 x 5 pixels centered about the noted corrected data, which 

will be then supplied to the class classification adaptive processing circuit 43. nra * ir « n r, 

5 As previously explained, the class classifying block is supplied to the class classrtymg unrt 45. and the prediction 
calculating block is supplied to toe adaptive processing unit 46. rQOriQrt 

At a step S22 the class classifying unit 45 performs the class classification processmg operatton wrth respect to 
the class classifying block. Namely, the class classifying unrt 45 detects a state of distribution of each of toe pixel levels 
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in the block, and then judges to which class, this class classifying block belongs. This class judging result is supplied as 
class information to the predictive coefficient ROM 81. „„w m «H 

It should be understood that in this embodiment, since the class classification process>ng operation is performed 
with ,£2?? Z ^classifying block constructed* 5 pixels expressed by 2 bits, each of the Cass class.fy.ng 
Hinrkci rtassified into any one of 1024 classes (= (2 J^. 

T^en toe tScess operation is advanced to a step S23'. at which predictive coeffic,ents <""^<™* "* 
classare read In Step 24" an adaptive process is executed by predicting unit 82 to calculate predictive values. In step 
S25" The pSile va,ues are output by predicting unit 82. Step S21 is then returned to and the same process .s 

minina unrt of bSh thefL and second embodiments as illustrated in Figure 13. the controller 67 of F,gu^34 doesnot 
Su?priSeS coefficients for each class. Furthermore, the determining unit 24' does not .nctode a predictive oo* 

* e X*7eZ^Fwe\l ^operation of the determining unit 24' of Figure 34 is further explained. As with toe 
deteSing unTof Rgu^eTs at a firststep S41 . in the determining unit 24'. the comparator 64 judges as to whaher or 
aeierm.n.ng u » r( , rPive d from the error calculator 23. When the comparator 64 |udges that the error infor- 
mation is" « S J Returned to the step S41 . On the other hand, when the ccmparator 64 
Ses SrUhel^Hnformation is received, namely when the error information is stored in the error .nformation mem- 
oTv 5 me oloceS operation is advanced to a step S42. At this step S42. the comparator 64 compares a predeter- 
mined t£S the presently stored error information (present error information) so as to .udge that any 

0,16 M to TJi S42 iS wh?n It is so judged that the present error information is larger than or equa. to a predetermined 
threshold valuJ vtJcSnparator 64 reads out the preceding error information stored in the enor information memory 
£ Tnen S a step S43 thTcomparator 64 compares the preceding error information with the present error .nformation 
so as to judge whether or not the preceding error information is larger than the present error .nformation. 

fn ?uch a case that the process operation for 1 frame image is commenced, and the error .nformation is first sup- 
pli J stnce the precXerror information is not stored into the error information memory 63. in this case, the t *a*m 
orations defined after the step S43 will not be performed in the determining unit24. The controller 65 outputs a con- 
Signal I for controHing the conecting circuit 32 (Figure 5) in order to output a predeterm.ned inrtia addre* l 

When it is so judged at the step S43 that the present enor information is less than or equal to the preced.ng eiror 
inforn^tion namely wne * he compression data is corrected to thereby reduce the error information, the process oper- 
at nTa^anc™ to a s'ep S44. M this step S44. the controller 65 outputs to the correcting circuH 32. such a control 
s ana fo^stmcting that me correction value A is changed in a similar manner to that of the preced.ng case. Then, the 
oSss £Z£l returned to the step S41 . To the contrary, when it is so judged at the step S4 that the ^mmtrn^ 
rnTrmationTs larger than the preceding error information, namely when the error information .s increased by correcting 
to comTess ion data the process operation is advanced to a step S45. At this step S45. the controller 65 outputs o 
She SrTeS Scu?32 such a control signal for instructing that the conection value A is changed in a manner opposite 
to that of the preceding case. Then, the process operation is returned to the step S41 . 

„ should also be noted that when the continuously reduced error information ,s '"creased at certa.n timing, he con- 
troller 65 outputs such a control signal for instructing that the correction value A is decreased by. for example. 1/2. and 
is chanaed in a manner opposite to that of the previous case. 

Thea since the process operations defined from the step S41 to the step S45 are repeated, the error .nforn^on 
is decreased As a result, in the case that it is so judged at the step S42 that the present error .nformation .s smalle 
han a orSe7mined threshokl value "c". the process operation is advanced to a step S46. At th.s step S46 the control 
, SSTSS^Si corrected data of 1 frame stored in the corrected data memory 62. Then, the optimum com- 
oressed data are supplied to the transmitting/recording device, and the process is ended. 

Tnereafter, toe process operations are again repeated in accordance with the flow chart shown .n F.gure 34. wh.le 
waitino for the supply of the error information about the next frame. i**—*-^ 

W^^ 

o to the receiving apparatus of the first and second embodiments (Figure 15). since predictive coefficients to, ^each class 
are no t p^Sdto the receiving/reproducing unit 71 . there is no need for a separating un,t 72 as « F " 
more since predictive coefficients for each class are not provided to the receiving/reproducng unit 71 a predictive xoef- 
fidents ROM 78 is utilized to provide predictive coefficients for each class to the predicting un, ^ Otherwise, the 
nnpration of the receiving apparatus 4" of Figure 36 is the same as that of receding apparatus 4 of Figure 15. 

' tive classes in the predictive coefficient ROM 81' and 78. but average values of the p.xd values for constituting the 
eacheTbSks may be stored. In this case, when the class information is supplied, the pixel value corresponding to th,s 
ciass fs ouSS Accordingly, in the local decoder 22 of Figure 16. neither the block making unit for the pred.cted val- 
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ues calculation 42, nor the predicting unit 82 is provided. 

It should be understood that although the squared summation of the errors is employed as the error information in 
this embodiment, other factors such as an absolute value summation of errors and a summation of cubed errors may 
be used as the error information. A decision is made which error information is employed based on, for example, the 
convergence characteristic thereof. 

Also in this embodiment, the correcting operation of the compression data is repeated until the error information 
becomes less than a preselected threshold value V. Alternatively, it is also possible to make up an upper limit value as 
to the times of the correcting operation for the compression data. That is, in such a case that an image is transmitted in 
real time, the process operation for 1 frame must be ended within a predetermined time period. There is no definite con- 
dition such that the error information is converged within such a time period. Therefore, since an upper limit value is pro- 
vided with the times of the correction, when the error information is not converged less than the threshold value V 
within a predetermined time period, the process operation for this frame is accomplished (at this time, the corrected 
data is recognized as the coded result), and then the process operation for the next frame may be commenced. 

Furthermore, in this embodiment, the block is constituted by the image for 1 frame. Alternatively, the block may be 
constituted by pixels at the same positions over a plurality of time-sequential frames. 

Also in this embodiment, in the compressing unit 21 , the image is simply thinned, namely, the central pixel in the 
block made of 3 x 3 pixels is extracted, and then this is used as the compression data. Alternatively, the compressing 
unit 21 may calculate an average value of 9 pixels for constructing the block, and reduces (thins) the pixel number 
thereof by setting this average value as the pixel value of the central pixel in the block, so that this reduced data may be 
used as the compression data. 



Fourth Embodiment 



A fourth embodiment of the invention is now described with reference to the transmitting apparatus of Figure 18, 
the learning device for mapping coefficients of Figure 21 , the local decoder of Figure 23. and the learning device for pre- 
dictive coefficients of Figure 17. The receiving apparatus for use with this fourth embodiment is illustrated in Figure 27. 
Except as otherwise noted, the learning device for predictive coefficients of Figure 1 7 operates as previously descnbed 
with respect to the second embodiment of the invention. 

With reference now to Figure 18, the transmitting apparatus of the fourth embodiment is explained. 

Image data to be coded is provided to a block making unit 1 1 1 . The block making unit 1 1 1 processes the image 
data to make a class classifying block centered about the noted pixel corresponding to the unit for classifying this image 
data into a predetermined class, depending upon a nature thereof, and then supplies this class classifying block to an 
ADRC (adaptive dynamic range coding) processing unit 1 12 and a delay unit 1 15. 

The ADRC processing unit 112 executes the ADRC processing operation for the block (class classifying block) 
derived from the block making unit 1 1 1 . and then supplies a block constructed of the resultant ADRC code to a class 
classifying unit 113. . . 

In this case, according to the ADRC processing operation, the bit number of the pixels for constituting the class 

classifying block can be reduced. 

That is to say, for example, for the sake of a simple explanation, as indicated in Figure 19(A), considering such a 
block that is constructed of 4 pixels aligned on a straight line, both a maximum value "MAX" and a minimum value "MIN" 
of this pixel value are detected in the ADRC process operation, "men, assuming now that DR = MAX - MIN is used as 
a local dynamic range of the block, the pixel values of the pixels for constituting the block are requantized to k bits, 
based on this dynamic range DR. l t _, 

In other words, the minimum value MIN is subtracted from each of the pixel values within the block, and then the 
subtraction value is divided by DR/2 k . As a result, the resultant value is converted into a code (ADRC code) correspond- 
ing to the divided value. Concretely stated, for example, in a case where k = 2, as indicated in Figure 19(B), a judgment 
is made as to whether or not the divided value belongs any one of such ranges obtained by equally dividing the dynamic 
range DR by 4 (= 2 2 ). In the case that the divided value belongs to the lowermost level range, the second lowermost 
level range, the third lowermost level range, or the uppermost level range, each of the divided values is coded into 2 bits 
such as 00B. 01 B, 1 0B, or 1 1B (symbol "B" represents binary number). Then, on the decoding side, the ADRC code 
00B, 01 B. 10B, or 1 1 B is converted into a center value LOO of the lowermost level range, a center value L01 of the sec- 
ond lowermost level range, a center value L1 0 of the third lowermost level range, or a center value L1 1 of the uppermost 
level range. Then, the minimum value MIN is added to each of these values, so that the decoding operation is carried 

° Ut in this case, such an ADRC process operation is referred to as "non-edge matching". As indicated in Figure 19(C). 
contrary to this non-edge matching, there is a so-called improved "non-edge matching" corresponding to an ADRC 
processing operation. That is. in this ADRC processing operation, either the ADRC code 00B or the ADRC code 1 1 B is 
converted into an average value MIN' of the pixel values belonging to the lowermost level range obtained by equally 



21 



EP 0 820 195 A2 



dividing the dynamic range DR by 4, or another average value MAX' of the pixel values belonging to the uppermost level 
range. Also, both the ADRC codes 01 B and 10B are converted into a level obtained by equally dividing a dynamic range 
DR' defined by MAX'-MIN' by 3, so that the ADRC codes are decoded. 

It should be noted that a detailed description regarding this ADRC processing operation is disclosed in, for exam- 
5 pie, Japanese Laid-open Patent Application No. 3-53778 opened in 1 991 . which has been previously filed by the Appli- 
cant. 

As previously explained, the number of classes may be reduced by executing the ADRC processing operation such 
that the requantization is performed based on the bit number smaller than the bit number which is allocated to the pixels 
for constituting the block. 

w Returning back to Figure 18, the class classifying unit 1 13 executes a class classifying process operation for clas- 
sifying the block outputted from the ADRC processing unit 112 into a predetermined class, depending upon a nature 
thereof, and then supplies such information for indicating that this block belongs to any class as class information to a 
mapping coefficient memory 114. 

In such a case that, for instance, 8 bits or more are allocated to each of pixels, the class classifying block is 

is arranged by 9 pixels centered about the noted pixel (= 3x3). When the class classification process operation is per- 
formed with respect to such a class classifying block, this block is classified into such a huge number of classes, i.e., 
(2 8 ) 9 . 

Therefore, according to this embodiment, the ADRC process operation is carried out for the class classifying block 
in the ADRC processing unit 1 12. As a result, the class number is reduced by decreasing the bit number of the pixels 

20 for constituting the class classifying block, and further the class number is also reduced. That is. for example, when the 
ADRC processing operation of 1 bit is carried out in the ADRC processing unit 1 12, the class number is reduced from 
(2 8 ) 9 into (2 1 ) 9 . namely to 512. 

It should also be noted that in accordance with this embodiment, the class classification processing operation is 
carried out in the class classifying unit 113 based upon the ADRC code outputted from the ADRC processing unit 1 12. 

25 This class classification processing operation may be performed with respect to such data which have been processed 
by, for instance, DPCM (predictive decoding), BTC (block truncation coding), VQ (vector quantization), DCT (discrete 
cosine conversion), and Hadamard conversion. 

Again, returning back to Figure 18, as will be discussed later, the mapping coefficient memory 114 stores therein 
the mapping coefficients obtained from learning operations (mapping coefficient learning) every class information. 

30 While using the class information supplied from the class classifying unit 113, the mapping coefficient stored at this 
address is read out from this memory 1 1 1 to be supplied to a calculating unit 1 16. 

The delay unit 115 delays the block supplied from the block making unit 111 until the mapping coefficient corre- 
sponding to the class information of this block is read out from the mapping coefficient memory 114, and then supplies 
the delayed block to the calculating unit 1 16. 

35 The calculating unit 1 1 6 performs a predetermined calculation by employing the pixel values of the pixels for con- 
structing the block supplied from the delay unit 1 1 5, and further, the mapping coefficient corresponding to the class of 
this block, which is supplied from the mapping coefficient memory 1 14. so that such coded data is calculated, which is 
obtained by thinning (or reducing) the pixel number of this image to code this image. In other words, the calculating unit 
116 calculates a preselected function value T (y 1( y 2 , — , k 1f k 2 . — ), while using the following values as arguments. 

40 That is. the pixel values of the respective pixels for constructing the block outputted from the block making unit 1 1 1 are 
yi y 2> .„ an d the mapping coefficients corresponding to the class of this block, which are outputted from the mapping 
coefficient memory 114 are k1, k2, This calculated function value T (y 1t y 2 , ~, k 1( k 2 , — ) is outputted as, for 
instance, a pixel value of a center pixel among the pixels for constructing the block (class classifying block) outputted 
from the block making unit 111. 

45 Accordingly, assuming now that the number of pixels for constructing the class classifying block outputted from the 
block making unit 1 11 is equal to N pixels, the calculating unit 116 thins the image data by 1/N, and outputs the 1/N- 
thinned data as the coded data. 

It should be understood that the coded data outputted from the calculating unit 1 16 is not such data which is pro- 
duced by selecting to output the center pixel of the block arranged by the N pixels, namely produced by executing a sim- 

50 pie thinning process operation, but, as previously described, is equal to the function value T (y 1( y 2 . — . k 1f k^ — ) 
defined by the N pixels for constituting this block. Considering it from the different point of view, this function value T 
( Yli y 2i ... k 1( k 2 , — ) may be such an optimum value. That is, the pixel value of the central pixel in the block, which is 
obtained from the simple thinning process operation, is corrected as the optimum value capable of obtaining the original 
image data based on the pixel values located around this central pixel. Accordingly, the data obtained by calculating the 
55 mapping coefficient and the pixels for constituting the block will also be referred as "correction data", if required. 

Also, the calculation process executed in the calculating unit 1 16 may be conceived as such a process operation 
for mapping the pixel values of the respective pixels for constituting the class classifying block outputted by the block 
making unit 1 1 1 into the function T (y,. y 2 , — . k 1f k 2 , — ). Accordingly, the coefficients ^ , k 2 , — . used in such a process 
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operation will be referred to as "mapping coefficients". The calculating circuit 116 supplies the coded data to the level 
limiting unit 117. 

The level limiting unit 1 7 extracts 2-bit data of the MSB side of the coded data of 8 bits and suppl.es the coded data, 
limited to 2-bit data, to the transmitting/recording unit 1 1 8. 

The transmitting/recording unit 1 18 records the correction data supplied as the coded data from the level l.miting 
unit 117 on the recording medium 2, or transmits this correction data via the transmission path 3. 

Referring now to a flow chart of Figure 20, the operation of the transmitting apparatus of Figure 18 .s further 

eXPl ThSnage data is supplied in units of. for instance, 1 frame (field) to the block making unit 1 1 1 . In the block making 
unit 111 at a step S61 . the image for 1 frame is processed to make the class classifying block That is. for example as 
indicated in Figure 7 by surrounded by a rectangle, the block making unit 1 1 1 subdivides the image data into the dass 
classifying block constituted by 9 pixels centered about the noted pixel (3x3 pixels along transverse direction and lon- 
gitudinal direction), and successively supplies this class classifying block to the ADRC processing unit 112 and to the 

dela |n U Ws 1 case the class classifying block is arranged by the square-shaped block made of 3 x 3 pixels. Alternatively, 
the shape of this class classifying block is not limited to the square shape, but may be made from, for instance, a i rec- 
tangular^ a cross-shape, and other arbitrary shapes. Also, a total number of pixels for constituting the class classifying 
block is not limited to 9 pixels (namely. 3 x 3 pixels). Furthermore, the class dassifying block is not arranged by the 
adjoining pixels, but may be alternatively arranged by such pixels located apart from each other. It should be noted that 
the shape and the pixel quantity of the class classifying block must be made coincident with those during the learning 
operation (mapping coefficient learning operation, will be discussed later). 

At a step S62 upon receipt of the class classifying block from the block making unit 1 1 1 . the ADRC processing unit 
1 12 executes for example, the ADRC process operation of 1 bit with resped to this Hock, so that a block constituted 
by pixels expressed by 1 bit is accordingly made. The class classifying block which has been ADRC processed is fur- 
nished to the class classifying unit 113. -. 

In the class classifying unit 1 13. at a step SS3. the class dassifying block derived from the ADRC processing unit 
1 1 2 is classified into a class, and thus the resultant class information is supplied as an address to the mapping coeffi- 
-ient memory 1 14. As a consequence, the mapping coefficient corresponding to the class information furnished from 
the dass classifying unit 1 13 is read out from the mapping coefficient memory 1 1 4, and then is supplied to the calcu- 

lat ' n On n the other hand, in the delay unit 115. the class classifying block derived from the block making unit 111 is 
delayed and the delayed dass classifying block is supplied, while waiting for the mapping coefficient corresponding to 
the class information of this block is read out from the mapping coefficient memory 1 14. At a step S64. in the calculator 
1 16 the above-described function "f( • )" (symbol " • " appearing in this function "f" indicates a set of pixd vaJues y,. y* 
- and mapping coefficients k,. k 2 , -) is calculated by employing the pixel values of the respedive pixels for constitut- 
ing the class classifying block derived from the delay unit 1 1 5, and also the mapping coefficients read out from the map- 
ping coeffident memory 1 14. As a result, it is possible to calculate such corredion data produced by correcting the pixel 
value of the central pixel for constituting the class classifying block This conection data is outputted as the coded image 
data to the levellimiting unit 1 1 7. 

In the level limiting unit 117. at a step S65, the coded data of 8 bits is supplied as the 2-b.t data of the MSB side 
thereof to the transmitting/recording unit 1 18. In the transmitting/recording unit 1 18, at a step S66. the coded data sup- 
plied from the level limiting unit 1 17 is recorded on the recording medium 2. or transmitted via the transmission path 3. 

Then the process advanced to a step S67. at which a judgment made as to whether or not the process operation 
for the image data for 1 frame is accomplished. At this step S67. when it is so judged that the process operation for the 
image data for 1 frame is not yet completed, the process operation is returned to the previous step S62. at which the 
process operation defined after the step S62 is repeated for the next dass classifying block To the contrary, when it is 
so judged at the step S67 that the process operation for the image data for 1 frame is completed, the process operation 
is returned to the step S61 . at which the process operation defined after the step S61 is repeated for the next frame. 

Next Figure 21 illustrates a block diagram of an image processing apparatus for executing a learning (mapping 
coefficient learning) process operation used to calculate the mapping coefficients stored in the mapping coefficient 
memory 114 shown in Figure 18. 

In the memory 1 21 . the digital image data for training for more than 1 frame, which is suitable for the learning proc- 
ess (will be referred to as a "learning image" hereinafter, if necessary) is stored. A block making unit 122 reads the 
image data stored in the memory 121 , constitutes a class dassifying block identical to that outputted from the block 
making unit 1 1 1 shown in Figure 18. and then supplies the block to an ADRC processing unit 123 and to a calculating 



U ' 11 Either the ADRC processing unit 123 or the dass dassifying unit 1 24 executes a similar process operation to that 
of the ADRC processing unit 1 1 2 or the class classifying unit 1 1 3 shown in Figure 1 8. As a result, the dass information 
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of the block outputted from the block making unit 122 is outputted from the class classifying unit 124. Then, this class 
information is supplied as an address to the mapping coefficient memory 131 . 

The calculating unit 1 25 performs the same calculation as that of the calculating unit 1 16 of Figure 18 by employing 
the pixels for constituting the block supplied from the block making unit 1 22, and also the mapping coeff uaerit supplied 
from the mapping coefficient memory 131. Thus, the calculating unit 125 provides compressed data to a level limiting 
unit 126. This level limiting unit 126 limits the levels of the pixels of the compressed data and then supplies or 126 sup- 
plies the resultant correction data (function T ( • )) to the local decoder 1 27. 

Based upon the correction data supplied from the level limiting circuit 126, the local decoder 127 predicts (calcu- 
lates) a predicted values of an original learning image data (namely, predicted values of pixel values of pixels for con- 
structing block outputted from block making unit 122). and then supplies the predicted value to an error calculator 128. 
The error calculator 128 reads a pixel value (true value) of a learning image corresponding to the predicted values sup- 
plied from the local decoder 127, calculates (detects) a prediction error of the predicted values with respect to the pixel 
value of this learning image, and then supplies this calculated prediction error as error information to a determining unit 
129 

The determining unit 129 compares the error information supplied from the error calculator 128 with a predeter- 
mined threshold value " e 1 and then controls a mapping coefficient setting unit 1 30 in accordance with this comparison 
result Under control of the determining unit 129. the mapping coefficient setting unit 130 sets (changes) a set of map- 
ping coefficients, the number of which is identical to the number of classes obtained by the class classifying unit 124. 
and then supplies the changed set of the mapping coefficients to a mapping coefficient memory 131. 

The mapping coefficient memory 131 temporarily stores therein the mapping coefficient supplied from the mapping 
coefficient setting unit 130. It should be understood that the mapping coefficient memory 131 contains storage regions 
capable of storing mapping coefficients (set of mapping coefficients), the number of regions equal to the number 
classes to be classified in the class classifying unit 124. In each of the storage regions, when a new mapping coefficient 
is supplied from the mapping coefficient setting unit 1 30. this new mapping coefficient may be stored instead of the pre- 
25 viously stored mapping coefficient. 

Also the mapping coefficient memory 131 reads the mapping coefficient stored at the address corresponding to 
the class information supplied from the class classifying unit 124. and then supplies the read mapping coefficient to the 

calculating unit 1^ ^ ^ ^ ^ ^ operation of the learning device for mapping coefficients is further explained: 
so First at a step S71 . the mapping coefficient setting unit 1 30 sets a set of initial values of the mapping coefficients 
by only the number equal to the classes to be classified in the class classifying unit 124. and then supplies the set of 
these initial values to the mapping coefficient memory 131 . In this mapping coeff ident memory 131 , the mapping coef- 
ficient (initial value) derived from the mapping coefficient setting unit 130 is stored a the address of the corresponding 

35 daS Then at a step S72. the block making unit 122 processes all of the learning images stored in the memory 121 to 
make blocks constituted of 3 x 3 pixels centered about the noted pixel in a similar manner to that executed in the block 
making unit 1 1 1 shown in Figure 1 8. Furthermore, the block making unit 1 22 reads out this block from the memory 121, 
and sequentially supplies the read block to the ADRC processing unit 123 and the calculating unit 125. 

At a step S73. similar to the process operation by the ADRC processing unit 1 12 of Figure 18. the ADRC process- 
40 ing unit 123 performs the ADRC processing operation of 1 bit for the block outputted from the block making unit 122. 
and then supplies the ADRC-processed block to the class classifying unit 124. 

At a step S124. in the class classifying unit 124, a decision is made of a class of the block supplied from the ADRC 
processing unit 123, and this class information is supplied as an address to the mapping coefficient memory 131 . As a 
consequence, at a step S75. a mapping coefficient is read out from an address of the mapping coefficient memory 131 . 
45 which corresponds to the class information supplied from the class classifying unit 124, and then the read mapping 
coefficient is supplied to the calculating unit 1 26. 

When the block is received from the block making unit 122. and also the mapping coefficient corresponding to the 
class of this block is received from the mapping coefficient memory 131 . the calculating unit 125 calculates the above- 
explained function value "f( • )" by employing this mapping coefficient, and the pixel values of the pixels for constituting 
so the block supplied from the block making unit 122 at a step S76. This calculation result is furnished to the level limiting 
unit 126 as the compressed data obtained by correcting the pixel value of the central pixel of the block supplied from 
the block making unit 1 22. Then, as a consequence, at a step S77. 2 bit data from the MSB side is selected from 8 bit 
data and the pixel data, the 2-bit data of which is bit-limited, is supplied to the local decoder 127. 

In other words, for instance, in Figure 7. assuming now that the block of 3 x 3 pixels surrounded by the rectangle is 
55 outputted from the block making unit 122. the calculating unit 125 calculates correction data produced by correcting the 
pixel values of the pixels denoted by symbol - • " in this drawing, and this correction data is level-limited by the level lim- 
iting unit 1 26, and thereafter outputs this calculated correction data to the local decoder 1 27. 

As a consequence, in the calculating unit 126. the number of pixels for constituting the learning image data is 
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thinned by 1/9, and thus the thinned pixel number is supplied to the local decoder 127. 

Returning back to Figure 22, the process operation is advanced to a step S78, at which a check is made as to 
whether or not the correction data about all of the learning images stored in the memory 121 have been calculated. 
When it is so judged at the step S78 that the correction data about all of the learning data are not yet calculated, the 
5 process operation is returned to the previous step S73. Then, the process operations defined after the S73 to the step 
S78 are repeated until the correction data about all of the learning images are calculated. 

When it is so judged at the step S78 that the correction data about all of the learning images are calculated, namely 
when such a thinned image could be obtained which is produced by thinning all of the learning images stored in the 
memory 121 by 1/9, the process operation is advanced to a step S79 at which this 1/9-thinned image is local-decoded 
to in the local decoder 1 27, so that a predicted values of the original learning image data is calculated. It should be under- 
stood that this 1/9-thinned image is not equal to such a thinned image produced by simply thinning the learning image 
data by 1/9, but equal to another thinned image obtained by calculating the mapping coefficient to acquire the pixel 
value. Then, these predicted values are supplied to the error calculator 128. 

In this case, the image constituted by the predicted values obtained in this local decoder 127 (noting that, as will be 
is explained later, the image obtained when error information outputted from error calculator 128 becomes smaller than 
the threshold value el) is identical to the decoded image obtained on the side of the receiving apparatus 4 (Figure 1). 

In the error calculator 128, the learning image is read out from the memory 121 at a step S80. and then a prediction 
error of the predicted values supplied from the local decoder 127 with respect to this read learning image data is calcu- 
lated, in other words, when the pixel value of the learning image data is expressed as "Yjf, and the predicted values 
20 thereof outputted from the local decoder 127 is expressed as "EfYj-T, error dispersion (namely, squared summation of 
error) "Q" indicated by the following formula is calculated in the error calculator 128. This error dispersion is supplied as 
error information to the determining unit 129. 

Q = x(Y ..-E[Y g]) 2 , where symbol "Z" indicates a summation of all pixels of the learning images. 
Upon receipt of the error information from the error calculator 128. the determining unit 129 compares this error 
25 information with the preselected threshold value VT, and judges as to whether or not this error information is larger 
than the threshold value *e1 " at a step S81 . When it is judged at the step S81 that the error information is larger than, 
or equal to the threshold value "el", namely in the case that no recognition is made that the image constituted by the 
predicted values obtained in the local decoder 1 27 is equal to the original learning image data, the determining unit 1 29 
outputs a control signal to the mapping coefficient setting unit 130. At a step S82, in response to the control signal 
30 derived from the determining unit 129. the mapping coefficient setting unit 130 changes the mapping coefficient and 
causes this changed mapping coefficient to be newly stored into the mapping coefficient memory 131 . 

Then, the process operation is returned to the previous step S73, at which the process operations defined after the 
step S73 are again repeated by employing the changed mapping coefficient stored in the mapping coefficient memory 
131. 

35 Now, it should be understood that the mapping coefficient may be varied at random in the mapping coefficient set- 
ting unit 130. Alternatively, in such a case that the present error information becomes smaller than the preceding error 
information, the mapping coefficient may be changed in accordance with a trend similar to the preceding trend. Also, in 
the case that the present error information becomes larger than the preceding error information, the mapping coefficient 
may be changed in accordance with a trend opposite to the previous trend. 

40 Furthermore, the mapping coefficient may be changed as to all of the classes, or a portion of the classes. When 
only the mapping coefficient as to a portion of the classes is changed, for example, such a class capable of giving a 
strong influence to error information is detected, and then only such a mapping coefficient may be varied. A class capa- 
ble of giving a strong influence to error information may be detected as follows. That is, first of all. the process operation 
is carried out by employing an initial value of a mapping coefficient to thereby obtain error information thereof. Thereaf- 

45 ter, the mapping coefficient is changed by the same amount every 1 class, and the resulting error information is com- 
pared with the error information obtained when the initial value is employed. The class in which the comparison 
difference becomes larger than, or equal to a predetermined value may be detected as the class capable of giving a 
strong influence to the error information. 

Also, in such a case that a plurality of mapping coefficients such as the above-described k 1f k 2 . — are set as 1 set, 

so only the mapping coefficient capable of giving the strong influence to the error information among then may be 
changed. 

Furthermore, in the above case, the mapping efficient are set every class. Alternatively, the mapping efficient may 
be independently set with respect to. for instance, each of the blocks, or in unit of the adjoining blocks. 

It should be noted that, for example, when the mapping coefficient is independently set every block , there are some 
55 possibilities that plural sets of mapping coefficients are acquired with respect to a certain single class (conversely, there 
are some possibilities that a class will occur where a set of mapping coefficient could not be obtained). Finally, since 
the mapping coefficient should be determined every class, as explained before, when plural sets of mapping coeffi- 
cients are obtained as to a certain class, a certain process operation, merge operation or select operation is carried out 
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for the plural sets of mapping coefficients, so that one set of mapping coefficient must be determined. 

On the other hand, when it is so judged at the step S81 that the error information becomes smaller than the thresh- 
old value VT, namely when a recognition is made that the image constituted by the predicted values obtained in the 
local decoder 127 is identical to the original learning image data, the process operation is completed. 

At this time, the mapping coefficients every class, which have been stored in the mapping coefficient memory 131. 
are set into the mapping coefficient memory 1 1 4 of Figure 1 8 as the optimum mapping coefficients capable of obtaining 
the correction data by which the decoded image (predicted values) recognizable as the same image as the original 
image data can be reproduced. 

As a consequence, since the correction data is produced by using such a mapping coefficient it is possible to 
obtain the image substantially identical to the original image data on the side of the receiving apparatus 4 (Figure 1). 

As previously described, in the embodiment of Figure 21, the image is subdivided into the block constituted by 9 
pixels centered about the noted pixel (3x3 pixels) by the block making unit 122, whereas the ADRC processing oper- 
ation of 1 bits is carried out for the image block in the ADRC processing unit 123. As a consequence, the number of 
classes obtained by the class classification by the class classifying unit 124 is equal to 512 (=(2 1 ) 9 ). Accordingly. 512 
sets of mapping coefficients are obtained. 

Next. Figure 23 illustrates an example of an arrangement of the local decoder 127 shown in Figure 21 . 
The correction data derived from the level limiting unit 126 of Figure 21 is supplied to a block making unit for class 
classification 1 41 and to a block making unit for predicted value calculation 1 42. The block making unit for class classi- 
fication 141 makes class classifying blocks centered about the noted corrected data in unit used to classify the cor- 
rected data into a preselected class, depending upon a nature thereof. 

In other words, for instance, assuming now that in Figure 7. the correction data (compression data), (otherwise, 
pixel) (indicated by symbol " - " in Figure 7) located at an i-th position from the upper position and at a j-th position from 
the left position is expressed as w Xjf, the block making unit 141 for the class classification will constitute a class classi- 
fying block arranged by 5 pixels in total, namely, a pixel "Xf of interest and the following 4 pixels adjacent to this pixel 
of interest at upper, left, right, and lower positions: X^, X i(M)l X j(j+1) , X (M)j . This class classifying block is supplied to 
a class classifying unit 144. 

tt should be understood that the class classifying block obtained in the block making unit for class classification 141 
of Figure 23 is constituted in order to determine the class of the block used to calculate the predicted values. At this 
point, this class classifying block is different from the class classifying block produced in the block making unit 1 1 1 of 
Figure 1 8 so as to determine the class of the block for calculating the correction data. 

The block making unit for predicted values calculation 142 processes the correction data to make a predicted val- 
ues calculating block centered about the noted corrected data in unit used to calculate the predicted values of the orig- 
inal image data (namely, in this case, leaning image data). In other words, in this embodiment, pixel values of 9 pixels 
(= 3x3) in the original image data centered around the correction data Xij are expressed by: Yy(1), Yjj(2), Yjj(3), Yjj(4), 
Yij(5). Yi](6). Yjj(7), y^B), Y y (9). These pixel values may be obtained from 25 pixels (= 5x5) centered around the pixel 
"Xjf. These 25 pixels are defined by: X (j _ 2)(j _ 2) , X (i-2)G-1)« x 0-2)j« ^JG+i)- ^KM*). X (i-1)G-2V X (M)G-1)» x 0-i)i. X (i-1)G+1)» X 0- 

1)0+2). X iG-2> X i( H), Xij. X i(j+1). X i(j+2). X (i + 1)(j-2). X (i + 1(M)* X C»1)J' X (i+1)(MV X 0+1)G+2). X (h-2)G-2). X (i+2)G-1). X (i + 2)j. X (i + 2)Q+1). 
X 

( ' +2 Concretely stated, for instance, in Figure 7. to calculate the predicted values of the pixels Y33(1) to Y33(9) in the 
original image data surrounded by a rectangular, the predicted values calculating block is constructed by 25 the follow- 
ing pixels (correction data): X in , X 12 , X 13 . X 14 , X 15 , X 21 . X22. X 23 . X 24 . X 25 , X 31 , X 32 . X 33 . X 34 . X 35 . X 41 . X 42 , X^, X^. 

X 45« X 51 • X 52» X 53» X 54» X 55- 

The predicted values calculating block obtained in the block making unit for predicted value calculation 1 42 are sup- 
plied to a predicting unit 1 46. 

Similar to the case of the class classifying block, the pixel number and the shape as to the predicted values calcu- 
lating block are not limited to the above-described examples. It should be noted that the total number of pixels for con- 
stituting the predicted values calculating block in the local decoder 127 is preferably made larger than the total number 
of pixels for constituting the class classifying block. 

Also, when the above-explained block making process is carried out (similar to process operations other than block 
making), there are no corresponding pixels near the image frame of the image. In this case, for example, the process 
operation may be performed, assuming now that the same pixels carried out (similar to process operations other than 
block making), there are no corresponding pixels near the image frame of the image. In this case, for example, the proc- 
ess operation may be performed, assuming now that the same pixels as those for constituting the image frame are 
located outside this image frame. 

The class classifying unit 144 classifies the block supplied from the block making unit for class classification 141. 
and then supplies the classified result as class information to a predictive coefficient ROM 145. The predictive coeffi- 
cient ROM 145 stores therein predictive coeff icients for each class, and when the class information is received from the 
class classifying unit 144. a predictive coefficient stored at an address corresponding to this class information is read 
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to be supplied to a predicting unit 146. It should be noted that the predictive coefficient stored in the predictive coeffi- 
cient ROM 145 are obtained by way of learning process operation (predictive coefficient learning, will be discussed 
later). 

The predicting unit 146 calculates (predicts) a predicted values of an original image data (learning image data) by 
employing the predicted values calculation block derived from the block making unit for predicted value calculation 142, 
and also the predictive coefficient read from the predictive coefficient ROM 145. 

Referring now to the flow chart of Figure 24, the operation of the local decoder 1 27 of Figure 23 is further explained. 

First, in the local decoder 127, at a step S91, the correction data derived from the level control unit 126 is sequen- 
tially received to be processed to make blocks. In other words, in the block making unit for class classification 141 , the 
correction data is subdivided into a class classifying block made of 5 pixels centered about the noted corrected data, 
which will be then supplied to the class classifying unit 144. In the block making unit for predicted values calculation 
142, the correction data is subdivided into a predicted values calculating block made of 5x5 pixels centered about the 
noted corrected data, which will be then supplied to the predicting unit 146. 

It should also be noted that in the block making unit for class classification 1 41 and the block making unit for pre- 
dicted value calculation 142, the corresponding class classifying block and the corresponding predicted values calcu- 
lating block are produced. That is to say, in block making unit for class classification 141, for instance, when a class 
classifying block made of 5 pixels centered around the correction data X 33 of Figure 7 is produced, whereas a predicted 
values calculating block constituted by 5x5 pixels centered around the same correction data X 33 is produced in the pre- 
dicted values calculating block. 

At a step S92, the class classifying unit 144 executes the class classification processing operation with respect to 
the class classifying block, namely, detects states of distribution of each of the levels of the corrected data in the block, 
to thereby judge as to such a class to which this class classifying block belongs. This class judgment result is supplied 
as the class information to the predictive coefficient ROM 1 45. 

It should be understood that in this embodiment of Figure 24, since the class classification processing operation is 
performed with respect to the class classifying block constructed of 5 pixels where 1 pixel is expressed by 2 bits, each 
of the class classifying blocks is classified into any one of 512 classes (= (2 s ) 5 ). 

Then, the process operation is advanced to a step S93. at which predictive coefficients are read out from the 
address of the predictive coefficient ROM 1 45, which corresponds to the class information supplied from the class clas- 
sifying unit 144. At a step S94, the predicting unit 146 calculates a predicted values E[y] of a predicted values "y" of the 
original image data by employing this predictive coefficient, and the 25 pixel values for constituting the predicted values 
calculating block supplied from the predicted values calculating block in accordance with the following linear equation: 

E[y] = w 1 x 1 + w 2 x 2 + — w 25 x 25 +w 0 , 

where symbols w 1( w 2 , — , w 0 represent predictive coefficients, and symbols x 1f x 2 . — denote pixel values (correction 
data) of pixels for constructing the predicted values calculating block, especially symbols w 0 , which is an offset coeffi- 
cient which is added so as to express E[y] by 8 bits, because the original 8-bit data "xj has been converted into the 2- 
bit data. 

Now, in the embodiment of Figure 23, as previously explained, the predicted values of the 9 pixels may be calcu- 
lated from the 25 pixels for constituting the predicted values calculating block. 

Concretely stated, for example, it is now assumed that class information C is outputted from the class classifying 
unit 144, and this class information C is related to a class classifying block constituted by 3x3 corrected data X 22 , X 23 , 
*24. x 32. x 33. x 34' X 42- X 43. X 44. where correction data X33 shown in Figure 7 is centered. Also, it is now assumed that 
as the predicted values calculating block, a predicted values calculating block making unit 142. This prediction calculat- 
ing block is arranged by X 11f X 12 , X 13 , X 14 , X 15 , X 21 , X 22 , X 23 , X 2 4, X 25 , X 31 , X 32 , X 33 , X 34 , X 35 , X 41 , X 42 , X 43 , X^, X 45 , 
X51. X 52 , X^. X54, X 55 , where correction data X 33 . is centered. 

Moreover, it is assumed that w^k) to w 25 (k). and w 0 (k) are stored as a set of predictive coefficients at an address 
corresponding to the class information C in the predictive coefficient ROM 145. 

In this case, predicted values E[Y 33 (1)] through E[Y 33 (9)] of the pixel values Y 33 (1) to Y 33 (9) of the 3x3 pixels 
(namely, a portion surrounded by a rectangle in Figure 7) in the original image data centered around the correction data 
X 33 are calculated in accordance with the following formula: 
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E[Y33(k)] = w , (k)X , , + w 2 (k)X 12 + w 3 (k)X 13 + w 4 (k)X , 4 + w s (k)X 15 + w 6 (k)X „ 
+ w 7 (k)X 22 + w 8 (k)X 23 + w 9 (k)X 24 + w 10 (k)X 2S + w , , (k)X 31 
+ w 12 (k)X 32 + w 13 (k)X 33 + w 14 (k)X M + w 15 (k)X 35 + w 16 (k)X 41 

+ W „(k)X 42 + W , 8 (k)X 43 + W 19 (k)X 44 + W 20 (k)X 45 + W 21 (k)X S1 
+ W 22 (k)X 52 + W 23 (k)X 53 + W 24 (k)X 54 + W 25(^X55 +W 0 (k) 

When 9 pieces of the predicted values are obtained at the step S94 in the ^e^nb^ r^ne, the process 
operation is returned to the previous step S91, at which the process operates defned from the step S91 to the step 
cqa =ro ronoated so that the predicted values are calculated in unit of 9 pixels. 

Z 'SSH^SSa for executing the ,eamin9 ° Perati ° n (PrediCtiVe - L Saliar 
acquTe Spri coefficients stored in the predictive coefficient ROM 145 of Figure 23 is constructed ,n a simrtar 

TOn NeKt°Rgw^2 F ^^ apparatus 4" corresponding to the transirtt- 

,in9 SS^SSS device 19, the coded data recorded on * reproduced, or the 

resold SS^c^StonbS* making unit 141 through the predicting unit 146 employed in the local decoder 
27 shown n fS e 23 Is a resuK. in the decoder 192. predicted values are calculated from 

an irSSe consied by these predicted values is oulputted as a decoded image in a ^J^**££ZF£ 
of thTlocaTd^^eVl27 of Figure 23. Predictive coefficients for each Cass stored in predictive coefficients ROM 197 
= ro tha «mo as oredictive coefficients used in mapping coefficients for the learning process. 

ST££!32^«i- the enor Nation to be less than a predetermined ******** 

rTtus 4 shown in Figure 27 is not used. However, in this alternative case, the image quality (resolution) of the resultant 
^STh'he'Sffor 4 fframe has been subdivided to make the image block in this embodiment, this b,ock may 
befo^cS 

"^oISs embodiment, as the error information, the square summation of the errors is empfoyed. Alternatively 
for exlmp e a summation of absolute values of the errors, and a summation of cubed errors may be 
erroTinformation. A decision is made which value is employed as the error information, by cons,der,ng the convergence 
characteristic thereof. 

Fifth Embodiment 

A fifth embodiment of the invention is now described with reference to the transmitting apparatus of Figure .18 the 
learninToeTceTor mapping coefficients of Figure 25 and the local decoder of Figure 23. The recemng apparatus or 
3 SJE emboSfment is illustrated in Figure 27. Except as otherwise noted, the transm.tting apparatus ; * figure 
Ts !ne loSl decoder of Figure 23 and the receiving apparatus of Figure 27 operate as previously descnbed w,th 

T ^£^<£^^^"to -apping coefficients for use in the frfth embodiment is now 
explS %u" 25" hows "he structure of an image processing apparatus for performing a learning (mapp-ng coeffi- 
2? learning) process used to calculate mapping co^fficiems for storage in the mappmgcoeff.cient memory 114 of F,g- 



ure 18 



\ shou.d be noted that according to the image processing apparatus of Figu re 21 . even 
exoressed by for instance, the linear equation, and further the non-linear equation, and the secondary, or more equa 
tons thfop^mum predictive coefficient may be obtained. To the contrary, in the image process '"0 fPP^"*^£ 
25 on J when the function T is expressed by the linear equation, the °P«rm.mpredic^e 

In other words, the image processing apparatus of Figure 25 may be used ,n the followng ^That is, £ Figure 
1 3 when the pixel values of the respective pixels for constituting the block made of 3 x 3 p.xels oufoutted from the ^block 
nikTng unrt 1 1 1 are set to y, , y 2 . -. y 9 . and the mapping coefficients outputted from the mapping coeffoent memory 
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1 1 4 are set to k, . k 2 , k 3 , — , kg, the calculating unit 1 1 6 calculates the function T (y, , y 2 . — . k, . kg, — ) in accordance 
with the below-mentioned formula to obtain correction data. 

f (•)«k 1 y 1 +k 2 y 2 + • • • +k 9 y 9 

To an optimum correction data calculating unit 160. a learning image data suitable for a learning operation is sup- 
plied in unit of for instance, 1 frame. The optimum correction data calculating unit 160 includes a compressing unit 170, 
a level limiting unit 1 71 . a correcting unit 1 72, a local decoder 1 73. an error calculating unit 174, and a determining unit 
175. The optimum correction data calculating unit 160 calculates a pixel value (will be referred to as "optimum correc- 
tion data" hereinafter, if necessary) for constituting an optimum image used to predict the original image data, being an 
image whose pixel number is reduced, from the learning image entered into this optimum correction data calculating 
unit 160 and then supplies this calculated pixel value to a buffer unit 176. 

In other words, the learning image data supplied to the optimum correction data calculating unit 160 is supplied to 
a compressing unit 170 and an error calculating unit 174. The compressing unit 170 simply thins (subsamples) the 
learning image data at the same rate as the rate under which the pixels are thinned by the calculating unit 1 1 6 of Figure 
18 so that the learning image data is compressed and the compressed image data is supplied to a level limiting unit 
1 71 That is in this embodiment, the learning image data is simply thinned by 1/9 (when 9 pixels of 3 x 3 pixels are set 
as 1 block, only a central pixel of this block is extracted). In the level limiting unit 1 71 , after the level of the pixel data is 
limited, the level-limited pixel data is outputted to the correcting unit 172. 

The correcting unit 172 corrects data under control of the determining unit 175, and this data is supplied from the 
level limiting unit 1 71 . and simply thinned and compressed, the level of which is limited to 2 bits by selecting 2 bits of 
the MSB side from 8-bit data (will be referred to as "compression data" hereinafter, if necessary). Then, the resultant 
data corrected in the correcting unit 172 is supplied to the local decoder 173, and this corrected data will be referred to 
as "correction data" hereinafter, if necessary, since as to this data, the pixel value of the central pixel in the block made 
of 3 x 3 pixels is corrected in a similar manner to the output from the calculating unit 116 of Figure 18. 

Similar to the case of the local decoder 127 of Figure 21, the local decoder 173 predicts the original image data 
(learning image data) based on the correction data derived from the correcting unit 172, and then supplies this pre- 
dicted values to the error calculator 1 74. 

Similar to the case of the error calculator 138 of Figure 21, the error calculating unit 174 calculates a prediction 
error of a predicted values derived from the local decoder 173 with respect to the original image data, which is entered 
into this error calculating unit 1 74. This prediction error is supplied as error information to the determining unit 1 75. 

Based on the error information derived from the error calculating unit 174, the determining unit 175 judges as to 
whether or not the correction data outputted from the correcting unit 1 72 is properly equal to the compressed original 
image data Then, when the determining unit 1 75 judges that the correction data outputted from the correcting unit 1 72 
is not properly equal to the compression result of the original image data, the determining unit 1 75 controls the correct- 
ing unit 172, and further corrects the compression data, so that the newly obtained correction data is outputted. Also, 
when the determining unit 1 75 judges as to whether or not the correction data outputted from the correcting unit 172 is 
properly equal to the compression result of the original image data, the correction data supplied from the correcting unit 
172 is supplied as optimum correction data to a buffer unit 176. 

The buffer unit 1 76 contains a memory 1 76A for storing therein the optimum correction data supplied from the opti- 
mum correction data calculating unit 160. Furthermore, the buffer unit 176 reads out such an optimum correction data 
corresponding to the central pixel of the block read from a memory 177A of a block making unit 177, among the opti- 
mum correction data stored in the memory 176A. It should be noted that when the correction data for 1 frame is stored 
in the memory 1 76A. the buffer unit 1 76 outputs to the block making unit 1 77 a control signal for indicating this data stor- 
age. 

To the block making unit 177, similar to the optimum correction data calculating unit 160, the learning image data 
is supplied in units of 1 frame. The block making unit 1 77 contains a memory 177A for storing therein the learning image 
data supplied thereto. Upon receipt of the control signal sent from the buffer unit 176, the block making unit 177 subdi- 
vides the learning image data stored in the memory 177A into a block constructed of 3x3 pixels in a similar manner that 
of the block making unit 1 1 1 of Figure 18. Then, this block is sequentially read to be supplied to an ADRC processing 
unit 1 78 and a memory 180. 

When the block is read from the memory 177A contained in the block making unit 177, the block making unit 177 
supplies a control signal indicative of a position of this block to the buffer unit 1 76. In the buffer unit 1 76, the block of 3 
x 3 pixels read from the memory 177A is recognized in response to this control signal, and then, as previously 
explained, the optimum correction data corresponding to the central pixel of this block is read from the memory 176A. 
That is, as a result, both a certain block constituted by 3x3 pixels and the optimum correction data corresponding to this 
block are supplied at the same time to the memory 1 80. 

The ADRC processing unit 1 78 and the class classifying unit 1 79 are arranged similar to the ADRC processing unit 
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1 1 2 and the class classifying unit 1 1 3 of Figure 18. respectively. The class information about the block derived from the 
block making unit 1 77. outputted from the class classifying unit 1 79 is supplied as the address to the memory 1 80. 

The memory 180 stores therein the optimum correction data supplied from the buffer unit 176. and the block sup- 
plied from the block making unit 177 with establishing a correspondence relationship at an address ^sponding to 
the class information supplied from the class classifying unit 1 79. Note that .n the memory 1 80. apluralrty of information 
can be stored at one address. As a result, plural sets of both the optimum correction data and the block corresponding 
to certain class information can be stored. . , , ■ 

A calculating unit 1 81 reads out both the 9 pixels y, , y 2 y 9 for constituting the block of 3x3 pixels of the earning 

image data and the optimum correction data y' corresponding to this block, stored in the memory 180. Then the m,n- 
imum square method is applied to them, so that the mapping coefficients k, . to k* are calculated every class to be sup- 
plied to a memory 182. The memory 182 stores therein the mapping coefficients k, to ks every class supphed from the 
calculating unit 1 81 at the address corresponding to this class. 

Referring now to the flow chart shown in Figure 26. operation of the image processing apparatus of F.gure 25 is 

fUrth ^XeSrning image data is inputted, this learning image data is stored in the memory 177A of the block mak- 
ing unit 1 77. and supplied to the optimum correction data calculating unit 160. At a step S1 01 . upon receipt of the learn- 
ing image data the optimum correction data calculating unit 160 calculates the optimum correction data as to th.s 

' ear The pTSs Operation defined at this step S101 is similar to the process operation of the flow chart shown in Figure 
4 That is first at a step S1 , the compressing unit 170 produces the compression data by thinning the learning image 
by 1/9 At a step S2 this data is limited by the level limiting unit 171 . and thereafter the level-limrted data is firstly out- 
putted via the correcting unit 1 72 to the local decoder 1 73 without any correction. In the local decoder 1 73 i at a step S3, 
a calculation is made of a predicted values of the original image data based upon the correction data (ashamed 
above, such compression data produced by simply thinning image data in the beginn.ng) supplied horn the > ejecting 
unit 172 (namely, local decoding operation is carried out). These predicted values are supplied to the error calculator 

174 When the predicted values of the original image data are received from the local decoder 173, the error calculator 

1 74 calculates a prediction error of the predicted values derived from the local decoder 1 73 with respect to the original 
image data at a step S4, and then supplies the calculated prediction error as error information to the determin.ng unit 

175 Upon receipt of the error information from the error calculator 174. the determining unit 175 judges as to whether 
or not the conection data outputted from the conecting unit 1 72 is properly equal to the compression result of the ong- 
inal imaoe data based on this error information at a step S5. 

In other words at the step S5. a check is made as to whether or not the error information is less than a predeter- 
mined threshold value V. When it is so judged at the step S5 that the error information is not less than this predeter- 
mined threshold value V. a recognition is made such that the correction data outputted by the correcting unit 1 72 is not 
properly equal to the compression result of the original image data. Then, the process operation is advanced to a step 
S6 at which the determining unit 1 75 controls the correcting unit 1 72 to thereby correct the compression data outputted 
from the level control unit 1 71 . The correcting unit 1 72 varies the correction amount (correction value A ) so as to cor- 
rect the compression data under control of the determining unit 175. The resultant correction data is outputted to the 
local decoder 173. Then, the process operation is returned to the step S3, at which a similar process operation is 

^^HSould be noted that the compression data may be corrected in a similar manner to, for example, changing of the 
mapping coefficient as previously explained in Figure 21. r ^ atorminBrt 

On the other hand, when it is so judged at the step S5 that the error information .s less than the predetermined 
threshold value V the determining unit 175 recognizes that the correction data outputted by the correcting unit 1 72 .s 
properly equal to the correction result of the original image data, and causes the correcting unit 1 72 to output the cor- 
rection data produced when the error information less than the predetermined threshold value V is acquired as the 
optimum correction data, to the buffer unit 1 76. Then, this optimum correction data is stored into the memory 1 76A con- 
tained in this buffer unit 1 76. and the process operation is returned. 

As previously described, the conection data obtained by correcting the compression data acquired when the error 
information is less than the predetermined threshold value V may be stored as the optimum correction data into the 
memory 1 76A It should be noted that since this optimum conection data causes the error information to be less than 
the predetermined threshold value V. when the predicted values is calculated by employing this optimum conection 
data it is possible to produce the image substantially identical to the original image data. 

Referring again to Figure 26. when the buffer unit 1 76 stores the optimum correction data for 1 frame into the mem- 
ory 1 76A thereof, the buffer unit 1 76 outputs the control signal to the block making unit 1 77. Upon receipt of the control 
signal derived from the buffer unit 176, at a step S102. the block making unit 177 subdivides the learning image stored 
in the memory 1 77A into the block constructed of 3x3 pixels. Then, the block making unit 1 77 reads out the block of the 
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learning image data stored in the memory 177A, and supplies this read block to the ADRC processing unit 178 and the 
memory 180. 

At the same time, when the block is read out from the memory 1 77 A, the block making unit 1 77 supplies the control 
signal indicative of the position of this block to the buffer unit 1 76. In response to this control signal, the buffer unit 176 
recognizes the block of 3x3 pixels read from the memory 177A, reads out the optimum correction data corresponding 
to the central pixel of this block, and then supplies this read optimum correction data to the memory 1 80. 

Then the process is advanced to a step S1 03, at which the block derived from the block making unit 1 77 is ADRC- 
processed, and further, this block is class-classified in the class classifying unit 1 79. This classification result is supplied 
as the address to the memory 1 80. 

At a step S104, the memory 180 stores therein the optimum correction data supplied from the buffer unit 176, and 
the block (learning data) supplied from the block making unit 177 with having the corresponding relationship at the 
address corresponding to the class information supplied from the class classifying unit 1 79. 

Then, the process operation is advanced to a step S105, at which a check is done as to whether or not both the 
block for 1 frame and the optimum correction data are stored in the memory 1 80. When it is so judged at the step S1 05 
that both the block for 1 frame and the optimum correction data are not yet stored in the memory 180. the next block is 
read out from the block making unit 1 77. and also the optimum correction data corresponding to this read block is read 
from the buffer unit 176. Then, the process operation is returned to the step S103. at which the process operations 
defined after the step S1 03 are repeated. 

To the contrary, when it is so judged at the step S105 that the block for 1 frame and the optimum correction data 
are stored in the memory 1 80. the process operation is advanced to a step S1 06 at which a check is done as to whether 
or not the process operations for all of the learning images are completed. At the step S1 06, it is judged that the process 
operations for all of the learning image data are not yet ended, the process operation is returned to the step S101 , at 
which the process operations defined after the step S101 are repeated for the next learning image. 

On the other hand, when it is judged at the step S1 06 that the process operations for all of the learning image data 
are completed, the process operation is advanced to a step S107, at which the calculating unit 181 reads both the opti- 
mum correction data and the block stored in the memory 180 every class, and then establishes the normal equation 
shown in the formula (7) based on these data and block. Furthermore, at a step Sl08,the calculating unit 181 solves 
this normal equation so as to calculate the mapping coefficients capable of minimizing the error every class. This map- 
ping coefficient is supplied to the memory 1 82 so as to be stored therein at a step S1 09. and then this process operation 

is ended. , . , 

In the case that the function T is expressed by the linear equation, the mapping coefficients stored in the memory 
182 in the above-described manner are stored into the mapping coefficient memory 114 of Figure 18. and the optimum 
correction data can be obtained by using this mapping coefficient. 

It should be noted that there are the following difficulties. That is, a sufficient number of normal equations capable 
of obtaining the mapping coefficient could not be obtained. In this case, in the calculating unit 1 16 of Figure 18, such a 
mapping coefficient is set as a default value, namely to k 2 = 1/9. from which for example, an average value of the 9 
pixels for constituting the block of 3x3 pixels outputted from the block making unit 1 1 1 is outputted. 

While the present invention has been described about the image processing apparatus, such image processing 
apparatus may have especially advantages in the following cases that, for example, the standardized television signal 
(NTSC TV signal) is coded, and a so-called "high-definition" television signal containing a large amount of data is 
decode. 

In summary, the configuration of the first embodiment of the invention comprises the transmitting apparatus of Fig- 
ure 3. the compressing unit of Figure 5. the local decoder of Figure 8. the error calculator of Figure 1 1 and the deter- 
mining unit of Figure 1 3. The receiving apparatus of Figure 1 5 is utilized with the first embodiment The configuration of 
the second embodiment of the invention comprises the transmitting apparatus of Figure 28, the compressing unit of Fig- 
ure 5, the local decoder of Figure 16, the error calculator of Figure 1 1, the determining unit of Figure 13 and the learning 
device for predictive coefficients of Figure 17. The receiving apparatus of Figure 15 is utilized with the second embodi- 
ment. The conf iguration of the third embodiment of the invention comprises the transmitting apparatus of Figure 30, the 
compressing unit of Figure 5. the local decoder of Figure 32, the error calculator of Figure 1 1 and the determining unit 
of Figure 34. The receiving apparatus of Figure 36 is utilized with the third embodiment. The configuration of the fourth 
embodiment comprises the transmitting apparatus of Figure 18. the learning device for mapping coefficients of Figure 
21 . the local decoder of Figure 23 and the learning device for predictive coefficients of Figure 17. "me receiving appa- 
ratus of Figure 27 is utilized with the fourth embodiment. The configuration of the fifth embodiment comprises the trans- 
mitting apparatus of Figure 18, the learning device for mapping coefficients of Figure 25 and the local decoder of Figure 
23. The receiving apparatus of Figure 27 is utilized with the fifth embodiment. 

Although only certain embodiments have been described in detail, those having ordinary skill in the art will certainly 
understand that many modifications are possible without departing from the teachings hereof. All such modifications 
are intended to be encompassed within the scope of the following claims. 
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Claims 

1 . An apparatus for coding image data having a plurality of pixels, comprising: 

means for reducing a number of pixels of original image data to generate compressed data; 
means for limiting a level of pixels of the compressed data to generate limited compressed data; 
means for correcting the limited compressed data to generate corrected data; 

means for predicting the original image data in accordance with the corrected data and for generating pre- 
dicted data having a plurality of predicted pixels; 

means for calculating, with respect to the original image data, a predictive error of the predicted data; 
means for determining suitability of the corrected data as coded data based upon the predicted error; and 
means for outputting the corrected data as coded data of the original image data based upon the determined 
suitability. 

2. The apparatus of claim 1 , wherein the means for predicting comprises: 

means for generating class information of the corrected data; and 

means for generating the predicted pixels in accordance with the class information. 

3. The apparatus of claim 1, wherein the means for predicting, comprises: 

means for generating predictive coefficients based upon the corrected data; and 

means for generating the predicted pixels based upon the corrected data and the predictive coefficients. 

4. The apparatus of claim 1 , wherein the means for predicting comprises: 

means for generating class information based upon a plurality of pixels of the corrected data; 
means for generating predictive coefficients for each class based upon the original image data and the cor- 
rected data; and 

means for generating the plurality of predicted pixels based upon the predictive coefficients corresponding to 
information of each class and the corrected data. 

5. The apparatus of claim 4, wherein the means for outputting outputs the coded data with the predictive coeffi- 
cients for each class. 

6. The apparatus of claim 1 , wherein the means for predicting comprises: 

a memory for storing predictive coefficients for each class; 

means for generating class information based upon a plurality of pixels of the corrected data; and 

means for reading from the memory the predictive coefficients corresponding to the information of each class 

and for generating the predicted pixels based upon the read predictive coefficients and the corrected data. 

7. The apparatus of claim 6, wherein the predictive coefficients for each class stored in the memory are generated 
based upon original image data for learning. 

8. The apparatus of claim 7, wherein the means for outputting outputs the coded data with the predictive coeffi- 
cients for each class. 

9. The apparatus of claim 1 , wherein the means for correcting comprises: 

a memory for storing correction values, wherein the means for correcting corrects the compressed data using 
the correction values. 

1 0. The apparatus of claim 1 , wherein 

the means for determining determines suitability of the corrected data by detecting whether the predicted error 
is less than a prescribed threshold value; and 

the means for outputting outputs the corrected data as the coded data if the predicted error is less than the pre- 
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scribed threshold value. 

1 1 . An apparatus for decoding coded data generated by coding image data, comprising: 

5 means for receiving the coded data; and 

means for decoding the coded data and generating decoded image data, wherein the coded data is generated 
by the steps of : 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
70 correcting the limited compressed data to generate corrected data; 

predicting the original image data in accordance with the corrected data and generating predicted data having 
a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; 
is repeating the step of correcting until the corrected data becomes an optimum corrected data; and 

outputting the optimum corrected data as coded data. 

12. The apparatus of claim 1 1 , wherein the decoding means comprises: 

20 means for generating class information of the coded data; and 

means for producing the decoded image data in accordance with the class information. 

13. The apparatus of claim 1 1 , wherein the coded data includes predictive coefficients to produce the decoded 
image data, and the means for decoding comprises: 

25 

means for generating the decoded image data based upon the predictive coefficients and the coded data. 

14. The apparatus of claim 1 1 , wherein the coded data includes predictive coefficients for each class to produce 
the decoded image data, and the means for decoding comprises: 

30 

means for generating class information using a plurality of pixels of the coded data; 

means for producing the decoded image data using the predictive coefficients corresponding to the coded 
data. 

35 1 5. The apparatus of claim 1 1 , wherein the means for decoding comprises: 
a memory for storing predictive coefficients for each class; 

means for generating class information using a plurality of pixels of the coded data; and 
means for reading the predictive coefficients corresponding to the class information from the memory and gen- 
40 erating the predicted pixel using the read predictive coefficients and the coded data. 

16. The apparatus of claim 15, wherein the predictive coefficients for each class stored in the memory are gener- 
ated using original image data for learning. 

45 17. A method for coding image data having a plurality of pixels, comprising the steps of: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 
so predicting the original image data in accordance with the corrected data and generating predicted data having 

a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 

determining suitability of the corrected data as coded data of the original image based upon the predicted 

error; and 

55 outputting the corrected data as coded data of the original image data based upon the determined suitability. 

18. The method of claim 17, wherein the step of predicting comprises the steps of: 
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generating class information of the corrected data; and 

generating the predicted pixels in accordance with the class information. 

19. The method of claim 17, wherein the step of predicting, comprises the steps of: 

generating predictive coefficients based upon the corrected data; and 

generating the predicted pixels based upon the corrected data and the predictive coefficients. 

20. The method of claim 17, wherein the step of predicting comprises the steps of: 
generating class information based upon a plurality of pixels of the corrected data; 

generating predictive coefficients for each class based upon the original image data and the corrected data; 
and 

generating the plurality of predicted pixels based upon the predictive coefficients corresponding to information 
of each class and the corrected data. 

21. The method of claim 20, further comprising the step of: 

outputting the coded data with the predictive coefficients for each class. 

22. The method of claim 1 7, wherein the step of predicting comprises the steps of: 
storing predictive coefficients for each class; 

generating class information based upon a plurality of pixels of the corrected data; and 
reading from the memory the predictive coefficients corresponding to the information of each class and for gen- 
erating the predicted pixels based upon the read predictive coefficients and the corrected data. 

23. The method of claim 22, wherein stored predictive coefficients for each class are generated based upon original 
image data for learning. 

24. The method of claim 23, wherein the coded data is output with the predictive coefficients for each class. 

25. The method of claim 1 7, wherein the step of correcting comprises the step of: 

storing correction values, wherein the compressed data is corrected using the correction values. 

26. The method of claim 1 7, wherein the step of determining suitability comprises the steps of: 
detecting whether the predicted error is less than a prescribed threshold value; and 

outputting the corrected data as the coded data if the predicted error is less than the prescribed threshold 
value. 

27. A method for decoding coded data generated by coding image data, comprising the steps of: 
receiving the coded data; and 

decoding the coded data and generating decoding image data, wherein the coded data is generated by the 
steps of: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 

predicting the original image data in accordance with the corrected data and for generating predicted data hav- 
ing a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 

determining suitability of the corrected data as coded data based upon the predicted error; and 

outputting the corrected data as coded data of the original image data based upon the determined suitability. 

28. The method of claim 27, wherein the step of decoding the coded data comprises the steps of: 
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generating class information of the coded data; and 

producing the decoded image data in accordance with the class information. 

29. The method of claim 27. wherein the coded data includes predictive coefficients to produce the decoded image 
5 data, and the step of decoding the coded data comprises the step of: 

generating the decoded image data based upon the predictive coefficients and the coded data. 

30. The method of claim 27, wherein the coded data includes predictive coefficients for each class to produce the 
w decoded image data, and the step of decoding the coded data comprises the steps of: 

generating class information using a plurality of pixels of the coded data; 

producing the decoded image data using the predictive coefficients corresponding to the coded data. 
15 31. The method of claim 27. wherein the step of decoding the coded data comprises the steps of: 
storing predictive coefficients for each class; 

generating class information using a plurality of pixels of the coded data; and 

reading the predictive coefficients corresponding to the class information from the memory and generating the 
20 predicted pixel using the read predictive coefficients and the coded data. 

32. The method of claim 31. wherein the stored predictive coefficients for each class generated using original 
image data for learning. 

25 33. An apparatus for coding image data having a plurality of pixels, comprising: 

a subsampling circuit for reducing a number of pixels of original image data to generate compressed data; 
a limiting circuit for limiting a level of pixels of the compressed data to generate limited compressed data; 
a correcting circuit for correcting the limited compressed data to generate corrected data; 
30 a predicting circuit for predicting the original image data in accordance with the corrected data and for gener- 

ating predicted data having a plurality of predicted pixels; 

a calculator for calculating, with respect to the original image data, a predictive error of the predicted data; 
a determining circuit for determining suitability of the corrected data as coded data based upon the predicted 
error; and 

35 an output circuit for outputting the corrected data as coded data of the original image data based upon the 

determined suitability. 

34. The apparatus of claim 33, wherein the predicting circuit comprises: 

40 a circuit for generating class information of the corrected data; and 

a circuit for generating the predicted pixels in accordance with the class information. 

35. The apparatus of claim 33, wherein the predicting circuit, comprises: 

45 a circuit for generating predictive coefficients based upon the corrected data; and 

a circuit for generating the predicted pixels based upon the corrected data and the predictive coefficients. 

36. The apparatus of claim 33. wherein the predicting circuit comprises: 

so a circuit for generating class information based upon a plurality of pixels of the corrected data; 

a circuit for generating predictive coefficients for each class based upon the original image data and the cor- 
rected data; and 

a circuit for generating the plurality of predicted pixels based upon the predictive coefficients corresponding to 
information of each class and the corrected data. 

55 

37. The apparatus of claim 36, wherein output circuit outputs the coded data with the predictive coefficients for each 
class. 
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38. The apparatus of claim 33, wherein the predicting circuit comprises: 
a memory for storing predictive coefficients for each class; 

a circuit for generating class information based upon a plurality of pixels of the corrected data; and 

a circuit for reading from the memory the predictive coefficients corresponding to the information of each class 

and for generating the predicted pixels based upon the read predictive coefficients and the corrected data. 

39. The apparatus of claim 38, wherein the predictive coefficients for each class stored in the memory are gener- 
ated based upon original image data for learning. 

40. The apparatus of claim 39, wherein the output circuit outputs the coded data with the predictive coefficients for 
each class. 

41 . The apparatus of claim 33, wherein the correcting circuit comprises: 

a memory for storing correction values, wherein the correcting circuit corrects the compressed data using the 
correction values. 

42. The apparatus of claim 33, wherein 

the determining circuit determines suitability of the corrected data by detecting whether the predicted error is 
less than a prescribed threshold value; and 

the output circuit outputs the corrected data as the coded data if the predicted error is less than the prescribed 
threshold value. 

43. An apparatus for decoding coded data generated by coding image data, comprising: 
a circuit for receiving the coded data; and 

a decoder for decoding the coded data and generating decoding image data, wherein the coded date is gen- 
erated by the steps of: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 

predicting the original image data in accordance with the corrected data and for generating predicted data 
having a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; and 
outputting the corrected data as coded data of the original image data based upon the determined suita- 
bility. 

44. The apparatus of claim 43, wherein the decoder comprises: 

a circuit for generating class information of the coded data; and 

a circuit for producing the decoded image data in accordance with the class information. 

45. The apparatus of claim 43, wherein the coded data includes predictive coefficients to produce the decoded 
image data, and the decoder comprises: 

a circuit for generating the decoded image data based upon the predictive coefficients and the coded data 

46. The apparatus of claim 43, wherein the coded data includes predictive coefficients for each class to produce 
the decoded image data, and the decoder comprises: 

a circuit for generating class information using a plurality of pixels of the coded data; 

a circuit for producing the decoded image data using the predictive coefficients corresponding to the coded 
data. 
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47. The apparatus of claim 43, wherein the decoder comprises: 
a memory for storing predictive coefficients for each class; 

a circuit for generating class information using a plurality of pixels of the coded data; and 

a circuit for reading the predictive coefficients corresponding to the class information from the memory and 

generating the predicted pixel using the read predictive coefficients and the coded data. 

48. The apparatus of claim 47, wherein the predictive coefficients for each class stored in the memory are gener- 
ated using original image data for learning. 

49. A method for transmitting image data having a plurality of pixels, comprising the steps of: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 

predicting the original image data in accordance with the corrected data and for generating predicted data hav- 
ing a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 

determining suitability of the corrected data as coded data based upon the predicted error; 

outputting the corrected data as coded data of the original image data based upon the determined suitability; 

and 

transmitting the outputted corrected data. 

50. The method of claim 49, wherein the step of predicting comprises the steps of: 

generating class information of the corrected data; and 

generating the predicted pixels in accordance with the class information. 

51 . The method of claim 49, wherein the step of predicting, comprises the steps of: 
generating predictive coefficients based upon the corrected data; and 

generating the predicted pixels based upon the corrected data and the predictive coefficients. 

52. The method of claim 49, wherein the step of predicting comprises the steps of: 
generating class information based upon a plurality of pixels of the corrected data; 

generating predictive coefficients for each class based upon the original image data and the corrected data; 
and 

generating the plurality of predicted pixels based upon the predictive coefficients corresponding to information 
of each class and the corrected data. 

53. The method of claim 52, further comprising the step of: 

outputting the coded data with the predictive coefficients for each class. 

54. The method of claim 49, wherein the step of predicting comprises the steps of: 
storing predictive coefficients for each class; 

generating class information based upon a plurality of pixels of the corrected data; and 
reading from the memory the predictive coefficients corresponding to the information of each class and for gen- 
erating the predicted pixels based upon the read predictive coefficients and the corrected data. 

55. The method of claim 54, wherein stored predictive coefficients for each class are generated based upon original 
image data for learning. 

56. The method of claim 55. wherein the coded data is output with the predictive coefficients for each class. 

57. The method of claim 49, wherein the step of correcting comprises the step of: 
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storing correction values, wherein the compressed data is corrected using the correction values. 
58. The method of claim 49, wherein the step of determining suitability comprises the steps of: 

5 detecting whether the predicted error is less than a prescribed threshold value; and 

outputting the corrected data as the coded data if the predicted error is less than the prescribed threshold 
value. 

60. A recording medium having an encoded digital signal recorded thereon, the recording medium being prepared 
w by the steps of: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 
15 predicting the original image data in accordance with the corrected data and for generating predicted data hav- 

ing a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; 
outputting the corrected data as coded data of the original image data based upon the determined suitability; 
20 and 

recording the coded data on the recording medium. 

61 . The recording medium of claim 60, wherein the step of predicting comprises the steps of: 

25 generating class information of the corrected data; and 

generating the predicted pixels in accordance with the class information. 

62. The recording medium of claim 60, wherein the step of predicting, comprises the steps of: 

30 generating predictive coefficients based upon the corrected data; and 

generating the predicted pixels based upon the corrected data and the predictive coefficients. 

63. The recording medium of claim 60, wherein the step of predicting comprises the steps of: 

35 generating class information based upon a plurality of pixels of the corrected data; 

generating predictive coefficients for each dass based upon the original image data and the corrected data; 
and 

generating the plurality of predicted pixels based upon the predictive coefficients corresponding to information 
of each class and the corrected data. 

40 

64. The recording medium of claim 60, further comprising the step of: 
outputting the coded data with the predictive coefficients for each class. 

45 65. The recording medium of claim 60. wherein the step of predicting comprises the steps of: 
storing predictive coefficients for each class; 

generating class information based upon a plurality of pixels of the corrected data; and 
reading from the memory the predictive coefficients corresponding to the information of each class and for gen- 
so erating the predicted pixels based upon the read predictive coefficients and the corrected data. 

66. The recording medium of claim 65, wherein stored predictive coefficients for each class are generated based 
upon original image data for learning. 

55 67. The recording medium of claim 66, wherein the coded data is output with the predictive coefficients for each 

class. 

68. The recording medium of claim 60, wherein the step of correcting comprises the step of: 
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storing correction values, wherein the compressed data is corrected using the correction values. 

69. The recording medium of claim 60, wherein the step of determining suitability comprises the steps of: 
detecting whether the predicted error is less than a prescribed threshold value; and 

outputting the corrected data as the coded data if the predicted error is less than the prescribed threshold 
value. 

70. A method for coding data having a plurality of samples, comprising the steps of: 

reducing a number of samples of original data to generate compressed data; 

limiting a level of samples of the compressed data to generate limited compressed data; 

correcting the limited compressed data to generate corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted samples; 

calculating, with respect to the original data, a predictive error of the predicted data; 

determining suitability of the corrected data as coded data of the original data based upon the predicted error; 
and 

outputting the corrected data as coded data of the original data based upon the determined suitability. 

71 . The method of claim 70, wherein the step of predicting comprises the steps of: 

generating class information of the corrected data; and 

generating the predicted samples in accordance with the class information. 

72. The method of claim 70, wherein the step of predicting, comprises the steps of: 
generating predictive coefficients based upon the corrected data; and 

generating the predicted samples based upon the corrected data and the predictive coefficients. 

73. The method of claim 70, wherein the step of predicting comprises the steps of: 

generating class information based upon a plurality of samples of the corrected data; 
generating predictive coefficients for each class based upon the original data and the corrected data; and 
generating the plurality of predicted samples based upon the predictive coefficients corresponding to informa- 
tion of each class and the corrected data. 

74. The method of claim 73, further comprising the step of: 

outputting the coded data with the predictive coefficients for each class. 

75. The method of claim 70, wherein the step of predicting comprises the steps of: 
storing predictive coefficients for each class; 

generating class information based upon a plurality of samples of the corrected data; and 
reading from the memory the predictive coefficients corresponding to the information of each class and for gen- 
erating the predicted samples based upon the read predictive coefficients and the corrected data. 

76. The method of claim 75. wherein stored predictive coefficients for each class are generated based upon original 
data for learning. 

77. The method of claim 76, wherein the coded data is output with the predictive coefficients for each class. 

78. The method of claim 70, wherein the step of correcting comprises the step of: 

storing correction values, wherein the compressed data is corrected using the correction values. 

79. The method of claim 70, wherein the step of determining suitability comprises the steps of: 



39 



EP 0 820 195 A2 

detecting whether the predicted error is less than a prescribed threshold value; and 

outputting the corrected data as the coded data if the predicted error is less than the prescribed threshold 
value. 

80. A method for decoding coded data generated by coding data, comprising the steps of: 
receiving the coded data; and 

decoding the coded data and generating decoding data, wherein the coded data is generated by the steps of: 
limiting a level of samples of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 

predicting the original data in accordance with the corrected data and for generating predicted data having a 
plurality of predicted samples; 

calculating, with respect to the original data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; and 
outputting the corrected data as coded data of the original data based upon the determined suitability. 

81. The method of claim 80, wherein the step of decoding the coded data comprises the steps of: 

generating class information of the coded data; and 

producing the decoded data in accordance with the class information. 

82. The method of claim 80, wherein the coded data includes predictive coefficients to produce the decoded data, 
and the step of decoding the coded data comprises the step of: 

generating the decoded data based upon the predictive coefficients and the coded data 

83. The method of claim 80, wherein the coded data includes predictive coefficients for each class to produce the 
decoded data, and the step of decoding the coded data comprises the steps of: 

generating class information using a plurality of samples of the coded data; 

producing the decoded data using the predictive coefficients corresponding to the coded data. 

84. The method of claim 80, wherein the step of decoding the coded data comprises the steps of: 
storing predictive coefficients for each class; 

generating class information using a plurality of samples of the coded data; and 

reading the predictive coefficients corresponding to the class information from the memory and generating the 
predicted sample using the read predictive coefficients and the coded data. 

85. The method of claim 84, wherein the stored predictive coefficients for each class generated using original data 
for learning. 

86. An apparatus for coding data having a plurality of samples, comprising: 

a subsampling circuit for reducing a number of samples of original data to generate compressed data; 
a limiting circuit for limiting a level of samples of the compressed data to generate limited compressed data; 
a correcting circuit for correcting the limited compressed data to generate corrected data; 
a predicting circuit for predicting the original data in accordance with the corrected data and for generating pre- 
dicted data having a plurality of predicted samples; 

a calculator for calculating, with respect to the original data, a predictive error of the predicted data; 

a determining circuit for determining suitability of the corrected data as coded data based upon the predicted 

error; and 

an output circuit for outputting the corrected data as coded data of the original data based upon the determined 
suitability. 

87. The apparatus of claim 86, wherein the predicting circuit comprises: 
a circuit for generating class information of the corrected data; and 
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a circuit for generating the predicted samples in accordance with the class information. 

88. The apparatus of claim 86, wherein the predicting circuit, comprises: 

a circuit for generating predictive coefficients based upon the corrected data; and 

a circuit for generating the predicted samples based upon the corrected data and the predictive coefficients. 

89. The apparatus of claim 86, wherein the predicting circuit comprises: 

a circuit for generating class information based upon a plurality of samples of the corrected data; 

a circuit for generating predictive coefficients for each class based upon the original data and the corrected 

data; and 

a circuit for generating the plurality of predicted samples based upon the predictive coefficients corresponding 
to information of each class and the corrected data. 

90. The apparatus of claim 89, wherein output circuit outputs the coded data with the predictive coefficients for each 
class. 

91. The apparatus of claim 86, wherein the predicting circuit comprises: 
a memory for storing predictive coefficients for each class; 

a circuit for generating class information based upon a plurality of samples of the corrected data; and 

a circuit for reading from the memory the predictive coefficients corresponding to the information of each class 

and for generating the predicted samples based upon the read predictive coefficients and the corrected data. 

92. The apparatus of claim 91 , wherein the predictive coefficients for each class stored in the memory are gener- 
ated based upon original data for learning. 

93. The apparatus of claim 92, wherein the output circuit outputs the coded data with the predictive coefficients for 
each class. 

94. The apparatus of claim 86, wherein the correcting circuit comprises: 

a memory for storing correction values, wherein the correcting circuit corrects the compressed data using the 
correction values. 

95. The apparatus of claim 86, wherein 

the determining circuit determines suitability of the corrected data by detecting whether the predicted error is 
less than a prescribed threshold value; and 

the output circuit outputs the corrected data as the coded data if the predicted error is less than the prescribed 
threshold value. 

96. An apparatus for decoding coded data generated by coding data, comprising: 
a circuit for receiving the coded data; and 

a decoder for decoding the coded data and generating decoding data, wherein the coded data is generated by 
the steps of: 

reducing a number of samples of original data to generate compressed data; 
correcting the compressed data to generate corrected data; 

predicting the original data in accordance with the corrected data and for generating predicted data having a 
plurality of predicted samples; 

calculating, with respect to the original data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; and 
outputting the corrected data as coded data of the original data based upon the determined suitability. 

97. The apparatus of claim 96, wherein the decoder comprises: 
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a circuit for generating class information of the coded data; and 

a circuit for producing the decoded data in accordance with the class information. 

98. The apparatus of claim 96, wherein the coded data includes predictive coefficients to produce the decoded 
5 data, and the decoder comprises: 

a circuit for generating the decoded data based upon the predictive coefficients and the coded data. 

99. The apparatus of claim 96. wherein the coded data includes predictive coefficients for each class to produce 
io the decoded data, and the decoder comprises: 

a circuit for generating class information using a plurality of samples of the coded data; 

a circuit for producing the decoded data using the predictive coefficients corresponding to the coded data. 

15 1 00. The apparatus of claim 96, wherein the decoder comprises: 

a memory for storing predictive coefficients for each class; 

a circuit for generating class information using a plurality of samples of the coded data; and 
a circuit for reading the predictive coefficients corresponding to the class information from the memory and 
20 generating the predicted sample using the read predictive coefficients and the coded data. 

101 . The apparatus of claim 100, wherein the predictive coefficients for each class stored in the memory are gen- 
erated using original data for learning. 

25 1 02. An apparatus for coding image data having a plurality of pixels, comprising: 

means for extracting a plurality of pixels of the image data and generating class information corresponding to 
characteristics of the extracted plurality of pixels; 
means for storing mapping coefficients for each class; 
30 means for reading mapping coefficients for each class; 

means for reading mapping coefficients corresponding to the class information and for producing corrected 

data using the image data and the read mapping coefficients; and 

means for producing coded data by limiting a level of pixels of the corrected data. 

35 1 03. The apparatus of claim 102, wherein means for producing corrected data produces the corrected data where 
a number of pixels for the image data is reduced, by using the image data and the read mapping coefficients. 

104. The apparatus of claim 103, wherein the means for producing corrected data comprises: 

40 means for extracting a plurality of pixels from the image data; and 

means for producing the coded data where a number of pixels for the image data is reduced, by calculating the 
extracted plurality of pixels and the read mapping coefficients. 

105. The apparatus of claim 103, wherein 

45 

the mapping coefficients for each class are generated using original image data for learning. 

106. The apparatus of claim 103. wherein 

so the mapping coefficients for each class are generated so that predicted error between predicted data of original 

image data for learning, using the coded data and the original image data, is minimized. 

107. The apparatus of claim 103, wherein 

55 the mapping coefficients for each class are generated so that predicted error between predicted data of original 

image data for learning, predicted using the coded data and the original image data, is less than prescribed 
threshold values. 
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108. The apparatus of claim 103, further comprising: 

means for generating mapping coefficients for each class by 

extracting a plurality of pixels of the original image data for learning and generating class information corre- 
sponding to characteristics of the extracted plurality of pixels; 
limiting a level of pixels of the corrected data and generating limited corrected data; 

predicting the original image data for learning in accordance with the limited corrected data and generating pre- 
dicted data having a plurality of predicted pixels; 

generating predicted error of the predicted data of the original image data for learning with respect to the orig- 
inal image data for learning; 

updating mapping coefficients in accordance with the predicted error until the mapping coefficients are opti- 
mum mapping coefficients; and 
determining the optimum mapping coefficients. 

109. The apparatus of claim 103, further comprising: 

means for generating mapping coefficients for each class by 

generating compressed data by reducing the number of pixels of-original image data for learning; 
limiting a tevel of pixels of the compressed data and generating limited compressed data; 
correcting the limited compressed data and generated corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted pixels; 

calculating predictive error of the predicted data with respect to the original image data for learning; 
repeating the step of correcting until the corrected data is optimum corrected data; and 
generating optimum mapping coefficients for each class using the original image data for learning and the opti- 
mum corrected data. 

110. An apparatus for decoding coded data, generated by coding image data, comprising: 
means for receiving the coded data; and 

means for decoding the coded data to produce decoded image data, said coded data generated by the steps 

of: 

extracting a plurality of pixels of the image data and generating class information corresponding to charac- 
teristics of the extracted plurality of pixels; 
storing mapping coefficients for each class; 
reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data 
using the image data and the read mapping coefficients; and 
producing coded data by limiting a level of pixels of the corrected data. 

111. The apparatus of claim 110, wherein the corrected data is data where a number of pixels of the image data is 
reduced by using the image data and the read mapping coefficients. 

112. The apparatus of claim 111, wherein the decoding means comprises: 

a memory for storing predicted coefficients for each class used to generate the mapping coefficients for each 
class; 

means for extracting a plurality of pixels of the coded data and generating class information corresponding to 
the extracted plurality of pixels; and 

means for reading predicted coefficients corresponding to the class information and producing decoded image 
data using the coded data and the read predicted coefficients. 

113. The apparatus of claim 111, wherein 

the predicted coefficients for each class are generated using original image data for learning. 
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1 1 4. The apparatus of claim 111. wherein 

the mapping coefficients for each dass are generated using original image data for learning. 

115. The apparatus of claim 1 1 1 wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of the 
original image data for learning, predicted using the coded data and the original image data, is minimized. 

116. The apparatus of claim 111, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of the 
original image data for learning, predicted using the coded data and the original image data, is less than pre- 
scribed threshold values. 

1 17. A method for coding image data having a plurality of pixels, comprising the steps of: 

extracting a plurality of pixels of the image data and generating class information corresponding to character- 
istics of the extracted plurality of pixels; 
storing mapping coefficients for each class; 
reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data using the 

image data and the read mapping coefficients; and 

producing coded data by limiting a level of pixels of the corrected data. 

118. The method of claim 117, wherein the step of producing corrected data produces the corrected data where a 
number of pixels for the image data is reduced, by using the image data and the read mapping coefficients. 

119. The method of claim 1 1 8, wherein the step of producing corrected data comprises the steps of: 
extracting a plurality of pixels from the image data; and 

producing the coded data where a number of pixels for the image data is reduced, by calculating the extracted 
plurality of pixels and the read mapping coefficients. 

1 20. The method of claim 1 1 8, wherein 

the mapping coefficients for each class are generated using original image data for learning. 

121. The method of claim 118, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, using the coded data and the original image data, is minimized. 

122. The method of claim 118, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, predicted using the coded data and the original image data, is less than prescribed 
threshold values. 

123. The method of claim 1 18. wherein the step of generating mapping coefficients for each class comprises the 
steps of: 

extracting a plurality of pixels of the original image data for learning and generating class information corre- 
sponding to characteristics of the extracted plurality of pixels; 
limiting a level of pixels of the corrected data and generating limited corrected data; 

predicting the original image data for learning in accordance with the limited corrected data and generating pre- 
dicted data having a plurality of predicted pixels; 

generating predicted error of the predicted data of the original image data for learning with respect to the orig- 
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inal image data for learning; 

updating mapping coefficients in accordance with the predicted error until the mapping coefficients are opti- 
mum mapping coefficients; and 
determining the optimum mapping coefficients. 

5 

1 24. The method of claim 1 18, further comprising the steps of: 
generating mapping coefficients for each class by 

generating compressed data by reducing the number of pixels of original image data for learning; 
io limiting a level of pixels of the compressed data and generating limited compressed data; 

correcting the limited compressed data and generated corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted pixels; 

calculating predictive error of the predicted data with respect to the original image data for learning; 
is repeating the step of correcting until the corrected data is optimum corrected data; and 

generating optimum mapping coefficients for each class using the original image data for learning and the opti- 
mum corrected data. 

125. A method for decoding coded data generated by coding image data, comprising the steps of: 

20 

receiving the coded data; and 

decoding the coded data to produce decoded image data, said coded data generated by the steps of: 
extracting a plurality of pixels of the image data and generating class information corresponding to character- 
istics of the extracted plurality of pixels; 
25 storing mapping coefficients for each class; 

reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data using the 

image data and the read mapping coefficients; and 

producing coded data by limiting a level of pixels of the corrected data. 

30 

126. The method of claim 125, wherein the corrected data is data where a number of pixels of the image data is 
reduced by using the image data and the read mapping coefficients. 

127. The method of claim 1 26, wherein the step of decoding comprises the steps of: 

35 

storing predicted coefficients for each class used to generate the mapping coefficients for each class; 
extracting a plurality of pixels of the coded data and generating class information corresponding to the 
extracted plurality of pixels; and 

reading predicted coefficients corresponding to the class information and producing decoded image data using 
40 the coded data and the read predicted coefficients. 

128. The method of claim 126, wherein 

the predicted coefficients for each class are generated 

45 

using original image data for learning. 

129. The method of claim 126, wherein 

so the mapping coefficients for each class are generated using original image data for learning. 

130. The method of claim 126 wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of the 
55 original image data for learning, predicted using the coded data and the original image data, is minimized. 

131. The method of claim 126, wherein 
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the mapping coefficients for each class are generated so that predicted error between predicted data of the 
original image data for learning, predicted using the coded data and the original image data, is less than pre- 
scribed threshold values. 

1 32. A method for transmitting image data having a plurality of pixels, comprising the steps of: 

extracting a plurality of pixels of the image data and generating class information corresponding to character- 
istics of the extracted plurality of pixels; 
storing mapping coefficients for each class; 
reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data using the 
image data and the read mapping coefficients; 

producing coded data by limiting a level of pixels of the corrected data; and 
transmitting the coded data. 

133. The method of claim 132, wherein the step of producing corrected data produces the corrected data where a 
number of pixels for the image data is reduced, by using the image data and the read mapping coefficients. 

134. The method of claim 133, wherein the step of producing corrected data comprises the steps of; 
extracting a plurality of pixels from the image data; and 

producing the coded data where a number of pixels for the image data is reduced, by calculating the extracted 
plurality of pixels and the read mapping coefficients. 

135. The method of claim 133, wherein 

the mapping coefficients for each class are generated using original image data for learning. 

136. The method of claim 133, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, using the coded data and the original image data, is minimized. 

137. The method of daim 133, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, predicted using the coded data and the original image data, is less than prescribed 
threshold values. 

138. The method of claim 133, wherein the step of generating mapping coefficients for each class comprises the 
steps of: 

extracting a plurality of pixels of the original image data for learning and generating class information corre- 
sponding to characteristics of the extracted plurality of pixels; 
limiting a level of pixels of the corrected data and generating limited corrected data; 

predicting the original image data for learning in accordance with the limited corrected data and generating pre- 
dicted data having a plurality of predicted pixels; 

generating predicted error of the predicted data of the original image data for learning with respect to the orig- 
inal image data for learning; 

updating mapping coefficients in accordance with the predicted error until the mapping coefficients are opti- 
mum mapping coefficients; and 
determining the optimum mapping coefficients. 

139. The method of claim 133, further comprising the steps of: 
generating mapping coefficients for each class by 

generating compressed data by reducing the number of pixels of original image data for learning; 
limiting a level of pixels of the compressed data and generating limited compressed data; 
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correcting the limited compressed data and generated corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted pixels; 

calculating predictive error of the predicted data with respect to the original image data for learning; 
repeating the step of correcting until the corrected data is optimum corrected data; and 
generating optimum mapping coefficients for each class using the original image data for learning and the opti- 
mum corrected data. 

140. A recording medium having an encoded digital signal recorded thereon, the recording medium being prepared 
by the steps of: 

extracting a plurality of pixels of the image data and generating class information corresponding to character- 
istics of the extracted plurality of pixels; 
storing mapping coefficients for each class; 
reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data using the* 
image data and the read mapping coefficients; 

producing coded data by limiting a level of pixels of the corrected data; and 
recording the coded data on the recording medium. 

1 41 . The recording medium of claim 1 40, wherein the step of producing corrected data produces the corrected data 
where a number of pixels for the image data is reduced, by using the image data and the read mapping coefficients. 

142. The recording medium of claim 141 , wherein the step of producing corrected data comprises the steps of: 
extracting a plurality of pixels from the image data; and 

producing the coded data where a number of pixels for the image data is reduced, by calculating the extracted 
plurality of pixels and the read mapping coefficients. 

143. The recording medium of claim 141 , wherein 

the mapping coefficients for each class are generated using original image data for learning. 

144. The recording medium of claim 141 , wherein 

the mapping coefficients for each dass are generated so that predicted error between predicted data of original 
image data for learning, using the coded data and the original image data, is minimized. 

145. The recording medium of claim 141, wherein 

the mapping coefficients for each dass are generated so that predicted error between predicted data of original 
image data for learning, predicted using the coded data and the original image data, is less than prescribed 
threshold values. 

1 46. The recording medium of claim 1 41 , wherein the step of generating mapping coefficients for each class com- 
prises the steps of: 

extracting a plurality of pixels of the original image data for learning and generating class information corre- 
sponding to characteristics of the extracted plurality of pixels, 
limiting a level of pixels of the corrected data and generating limited corrected data; 

predicting the original image data for learning in accordance with the limited corrected data and generating pre- 
dicted data having a plurality of predicted pixels; 

generating predicted error of the predicted data of the original image data for learning with respect to the orig- 
inal image data for learning; 

updating mapping coeffidents in accordance with the predicted error until the mapping coefficients are opti- 
mum mapping coefficients; and 
determining the optimum mapping coefficients. 
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147. The recording medium of daim 141, further comprising the steps of: 
generating mapping coefficients for each class by 

generating compressed data by reducing the number of pixels of original image data for learning; 
limiting a level of pixels of the compressed data and generating limited compressed data; 
correcting the limited compressed data and generated corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted pixels; 

calculating predictive error of the predicted data with respect to the original image data for learning; 
repeating the step of correcting until the corrected data is optimum corrected data; and 
generating optimum mapping coefficients for each class using the original image data for learning and the opti- 
mum corrected data. 

148. An apparatus for coding image data having a plurality of pixels, comprising: 

a subsampling circuit for extracting a plurality of pixels of the image data and generating class information cor- 
responding to characteristics of the extracted plurality of pixels; 
a memory storing mapping coefficients for each class; 
a circuit for reading mapping coefficients for each class; 

a circuit for reading mapping coefficients corresponding to the class information and for producing corrected 
data using the image data and the read mapping coefficients; and 

a limiting circuit for producing coded data by limiting a level of pixels of the corrected data. 

149. The apparatus of daim 148, wherein the drcuit for produdng corrected data produces the corrected data 
where a number of pixels for the image data is reduced, by using the image data and the read mapping coefficients. 

1 50. The apparatus of claim 149, wherein the drcuit for producing corrected data comprises: 
a circuit for extracting a plurality of pixels from the image data; and 

a circuit for producing the coded data where a number of pixels for the image data is reduced, by calculating 
the extracted plurality of pixels and the read mapping coefficients. 

151. The apparatus of claim 149, wherein 

the mapping coefficients for each class are generated using original image data for learning. 

152. The apparatus of claim 149, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, using the coded data and the original image data, is minimized. 

153. The apparatus of claim 149, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of original 
image data for learning, predicted using the coded data and the original image data, is less than prescribed 
threshold values. 

154. The apparatus of claim 149. further comprising: 

a circuit for generating mapping coeffidents for each class by 

extracting a plurality of pixels of the original image data for learning and generating dass information corre- 
sponding to characteristics of the extracted plurality of pixels; 
limiting a level of pixels of the corrected data and generating limited corrected data; 

predicting the original image data for learning in accordance with the limited corrected data and generating pre- 
dicted data having a plurality of predicted pixels; 

generating predicted error of the predicted data of the original image data for learning with respect to the orig- 
inal image data for learning; 

updating mapping coefficients in accordance with the predicted error until the mapping coefficients are opti- 
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mum mapping coefficients; and 

determining the optimum mapping coefficients. 

155. The apparatus of claim 149, further comprising: 

means for generating mapping coefficients for each class by 

generating compressed data by reducing the number of pixels of original image data for learning; 
limiting a level of pixels of the compressed data and generating limited compressed data; 
correcting the limited compressed data and generated corrected data; 

predicting the original data in accordance with the corrected data and generating predicted data having a plu- 
rality of predicted pixels; 

calculating predictive error of the predicted data with respect to the original image data for learning; 
repeating the step of correcting until the corrected data is optimum corrected data; and 
generating optimum mapping coefficients for each class using the original image data for learning and the opti- 
mum corrected data. 

156. An apparatus for decoding coded data generated by coding image data, comprising: 
a circuit for receiving the coded data; and 

a decoder for decoding the coded data to produce decoded image data, said coded data generated by the 
steps of: 

extracting a plurality of pixels of the image data and generating class information corresponding to character- 
istics of the extracted plurality of pixels; 
storing mapping coefficients for each class; 
reading mapping coefficients for each class; 

reading mapping coefficients corresponding to the class information and for producing corrected data using the 

image data and the read mapping coefficients; and 

producing coded data by limiting a level of pixels of the corrected data. 

157. The apparatus of claim 156, wherein the corrected data is data where a number of pixels of the image data is 
reduced by using the image data and the read mapping coefficients. 

158. The apparatus of claim 157, wherein the decoding means comprises: 

a memory for storing predicted coefficients for each class used to generate the mapping coefficients for each 
class; 

means for extracting a plurality of pixels of the coded data and generating class information corresponding to 
the extracted plurality of pixels; and 

means for reading predicted coefficients corresponding to the class information and producing decoded image 
data using the coded data and the read predicted coefficients. 

1 59. The apparatus of claim 1 57, wherein 

the predicted coefficients for each class are generated using original image data for learning. 

1 60. The apparatus of claim 1 57, wherein 

the mapping coefficients for each class are generated using original image data for learning. 

1 61 . The apparatus of claim 1 57 wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of the 
original image data for learning, predicted using the coded data and the original image data, is minimized. 

162. The apparatus of claim 157, wherein 

the mapping coefficients for each class are generated so that predicted error between predicted data of the 
original image data for learning, predicted using the coded data and the original image data, is less than pre- 
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scribed threshold values. * 

1 63. A method of transmitting coded image data, comprising the steps of: 

receiving the coded image data; and 
transmitting the coded image data, 

wherein the coded image data is produced by the following steps: 

reducing a number of pixels of original image data to generate compressed data; 
limiting a level of pixels of the compressed data to generate limited compressed data; 
correcting the limited compressed data to generate corrected data; 

predicting the original image data in accordance with the corrected data and for generating predicted data 
having a plurality of predicted pixels; 

calculating, with respect to the original image data, a predictive error of the predicted data; 
determining suitability of the corrected data as coded data based upon the predicted error; and 
outputting the corrected data as coded data of the original image data based upon the determined suita- 
bility. 

164. The method of daim 163, wherein the step of predicting comprises the steps of: 

generating class information of the corrected data; and 

generating the predicted pixels in accordance with the class information. 

165. The method of claim 163, wherein the step of predicting, comprises the steps of: 

generating predictive coefficients based upon the corrected data; and 

generating the predicted pixels based upon the corrected data and the predictive coefficients. 

166. The method of claim 163. wherein the step of predicting comprises the steps of: 
generating class information based upon a plurality of pixels of the corrected data; 

generating predictive coefficients for each class based upon the original image data and the corrected data; 
and 

generating the plurality of predicted pixels based upon the predictive coefficients corresponding to information 
of each class and the corrected data. 

1 67. The method of daim 166, further comprising the step of: 
outputting the coded data with the predictive coefficients for each class. 

1 68. The method of daim 163, wherein the step of predicting comprises the steps of: 
storing predictive coefficients for each class; 

generating class information based upon a plurality of pixels of the corrected data; and 
reading from the memory the predictive coefficients corresponding to the information of each class and for gen- 
erating the predicted pixels based upon the read predictive coefficients and the corrected data. 

169. The method of claim 168, wherein stored predictive coefficients for each class are generated based upon orig- 
inal image data for learning. 

170. The method of daim 169, wherein the coded data is output with the predictive coeffidents for each class. 

1 71 . The method of daim 163, wherein the step of correcting comprises the step of: 

storing correction values, wherein the compressed data is corrected using the correction values. 

172. The method of daim 163, wherein the step of determining suitability comprises the steps of: 
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detecting whether the predicted error is less than a prescribed threshold value; and 

outputting the corrected data as the coded data if the predicted error is less than the prescribed threshold 
value. 

5 



10 



15 



20 



25 



30 



35 



40 



45 



50 



51 



EP 0 820 195 A2 



FIG. 1 



digital image _ 

data 



transmitting 
apparatus 



2 

or 




4 



receiving 
apparatus 



decoded image 



FIG. 2 



image data • 



16 

I 

transmitting/ 
recording device 



l/F 

T 
11 



it 



coded data 



15 



17 



external storage device 
_ 



JL — 7~ 



ROM 

12 



RAM 
13 



14 



52 



EP 0 820 195 A2 



CD 
o 
o>> 

C CD 

E °> 

c/5 .£= 
C "O 

2 o 
— o 

O £ 



CO 

■o 

<D 

-o 

O 

o 



to 

CM 



0) 

a. 



CO 

d 



CO 
T3 

T3 
CD 
0) 

is 
-it 

§•8 



o <2 
a> o 

-a a> 



CO 
CM 



CM 



CO 
u 



© 

o 

CD 1/3 

o w 
o jo 
a> o 
> J= 

ss 



CM 
CM 



c 

l 1 

CD 



c 



c 
o 
o 



CD CD 

T3 a? 

CD > 



CD 

o 8 

O CD 

■a 



CM 



T3 

"O 

CD 

1 

S 



E 1 

05—05 

o S 



m 

X3 
CD 
O) 
CO 

E 



53 



EPO 820 195 A2 



FIG. 4 



Q start ) 







compress data 
(thinning) 






limit level 



-S1 



-S2 



correct 
compression data 



-S6 



execute local decode 



-S3 



calculate error 



— S4 



NO 



< 



error <£ ? 





YES 


multiplex optimum compression 
data and predictive coefficients 
for each class and output 
coded data 







Q end ^) 



54 



EP 0 820 195 A2 



c 



0) 

o5 



10 
(3 











ctio 


OS 


< 








O 






o 





CO 
CO 




2 § cm I 



CD 

E 



55 



EP 0 820 195 A2 



FIG. 6 

( a »" ) 



produce compression data 



limit level 



-S12 



< 



control signal 



S13 

NO 



YES 



output 
correction value 



S14 



correct 
compression data 



-S15 



output 
corrected data 



S16 



56 



BP 0 820 195 A2 



FIG. 7 



X11 




o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 



Y11(2)Y11(3) 

o o o 

Y11(5)Y11(6) 

o o 

Y11(8) Y11(9) 

o o o 

o o o 
moo 

X21 

o o o 

o o o 

• o o 

X31 

o o o 

o o o 
moo 

X41 

o o o 

o o o 

• o o 

X51 

o o o 



pixel 



o o o o o 



• o o • o o 

X12 X13 

o o o o o o 

o o o o o o 



X22 

o 



o o • o o 

X23 

Q Q O Q O 



Y33(1) Y33(2) Y33(3) 

o o o o o p 

X33-v _^»(4) Y33(5) Y33(6) 

otcj^ o p 

X32 

o o 



Y33(7) Y33(8) Y32(9) _ 

o o o o 



o o 

• o 

X14 

o o 

o o 

• o 

X24 

o o 



• o 

X15 

o o 



o o o 
o 
o 

o o o 

o m o 

X25 

o o o 



o 



X34 

o 



o 



o o o o o 



X42 



o o 



TO 



o o 



o o o o 

o o o o 

• o o • 

X52 X53 

o o o o 



o o 

o o 

o o 

o o 



o 
o 
o 
o o 

• o 

X44 

o o 

o o 

• o 

X54 

o o 



o 
o 



o o 
o 



X3S 

o o o 

o o o 

o • o 

X45 

o o o 

o o o 

o • o 

X55 

o o o 



block for class classification 



57 



EP 0 820 195 A2 



c 

03 
3= 

cd to 
o to 

O JO 

o> o 

> JC 

ss 



CD 

5 

© 

1 

CL 



CO 



CO 



c 

"to 
to 



> 

CO 
T3 
CO 
CD 

c 




(0 
CD 

E 



to E 



-2 U> 



cn 
c 

CO 

to :£= c 

CO CO 3 

° S 

o 



CM 
CM 




ca 
CO 
T3 

o 

w 

o 
o 



58 



EP 0 820 195 A2 



F I Gi 9 A pixe ' of interest 



o 



o o 



FIG. 9B 



o o 
o o 



• o 

o o 



o • 

o o 



o o 
o • 



o o 

• o 

• o 

• o 



o o 
# o 



o 
o 



o o 



o 



•0 

•1 



o » 



# o 



59 



EP 0 820 195 A2 



FIG. 10 



Q start ^ 



make block 



KS21 



classify class 



— S22 



execute adaptive 
process to calculate 
predicted value 
and predictive coefficients 
for each class 



-S23 



output predicted value 
and predictive coefficients 
for each class 



S24 



60 



EP 0 820 195 A2 




LO 











o 










o 






E 




CD 






j 






£ 



in 




co I 

CM 



CM 
ID 



CO 


CD 


15 


valu 








cn 




03 


Q) 


E 


O 




pred 



61 



EP 0 820 195 A2 



FIG. 12 



( START 



initialize memory 








blocking 






calculate square error 







integrate 



-S31 



-S32 



-S33 



-S34 



NO 



prescribed amount of image data processed? 



5? 



S35 



YES 



output error information 



-S36 



62 



EP 0 820 195 A2 



o 

x 
Cl 



CO 
CO 

ca 
o 
-1= 

CJ 

co 
a; 



"O o CO 



o 

CO 
CO 
CP 



8 

Q 




63 



EP 0 820 195 A2 



CO 




C 
O 

1 1 

~ CD 
O 



CO 
LU 




CI 
CO 



in 
CO 



3 

CO 




o- 
<o 
V 
c 
o 



CO 

§ 

o 
c 



o O 



03 CO 



00 



« 75 

o c o g 

O) 3, O ffi CL 

o-S O W O 

C E fc Q.t= 

/-k _ ^ o 



03 



CO 



o 

2 







CD 










valu 






as 




»— 


CD 

E 


o 










to 


(D 


.9 


CO 


CO 








CO 




"o 


CO 


rrec 


CD 


O 


c 


E 


E 


*> 


o 


o 


o 


to 




o 




o 


CO 





64 



EP0 820 195 A2 



CD 

cn 



a> 

8 



LO 

d 

LL 



o 
x: 

3 

<D 
k— 

tn 

C 
© 

*o 

3= 

a> 
o 
o 

> 
O 

2> 



£ c 

CD 




CO c 
to 
0> cO 



3 



o 2 

CD CO 

o 
o 




2. : 

CD 
co 



CM 

















'c 


a> o 




U w 




CD CL 




CD 









65 



EP 0 820 195 A2 



CD 

d 




o 
o 



8 



66 



EP 0 820 195 A2 





CM 



i of 

^ c fl 
U 3 Q) 

Q 




CO 
0) 

cn 

i 



67 



EP 0 820 195 A2 



CO 

1 















c 


CD 




mltti 


rdin 




CA 


8 




C 






2 













GO 

g 

LL. 




o 


i 


1 limit 


c 


level 





CM 







o 


c 


"co — 


cr 




Q 




< 


proc 



corrected [ 
data J 




calculating 
unit 






delay 


unit 




-I 



CO 



If) 



CD CO 



CO 

*5> 



68 



EP 0 820 195 A2 



FIG. 19A pixe, f ue 



MAX 
MIN 



-DR 

/— — 9 



block 



FIG. 19B 



MAX -r 



11- 
10< 
01- 
00< 



MIN 



L11 

Uo 
L01 
Loo 



DR 



FIG. 19C 



MAX t 



MAX' 



MIN -J- 




69 



EP 0 820 195 A2 



FIG. 20 



( sBn ) 



make block 








ADRC 






classify class 



-S61 



-S62 



-S63 



calculate correction data 



-S64 



limit level 



transmit 



—O 

NO X_ 



-S65 



-S66 



frame is ended? 



S67 

YES 



70 



EP0 820 195 A2 



FIG. 21 



digital 



image data -*-| memory 
for training 



121 



122 



123 



block 
making 
unit 




ADRC 






processing 
unit 



125 



class 

information 



124 



class 
classifying 
unit 



calculating 
unit 



AD 

mapping coefficients 
memory 



compressed 
data 



level limiting 
unit 



-126 



mapping coefficients 
setting unit 



local decoder 



error 
calculator 



127 

predicted value 
128 



el 



determining 
unit 

129 



error information 

control signal 



131 



130 



71 



EP0 820 195 A2 



FIG. 22 



Q start ) 
I set initial value of mapping coefficients] *S71 



make block 



-S72 



ADRC ^-S73 



execute class classification ~"-S74 



read mapping coefficients 
corresponding to class 



S75 



I calculate compressed data 



-S76 



limit level (~S77 
-S78 



NO 



Reaming image is ended^ 





YES 


execute local decode 












calculate error 





NO 



change 
mapping 
coefficients 



-S82 



error< e ? 
,,YES 

C e " d ) 



~S79 

S80 
S81 



7 



72 



EP 0 820 195 A2 



■§ o3CC 



co 
> 

03 
O 

O) 



CD 



CO 



CO 
CM 

d 

U- 





CD 










O) 


val 


er 
o 

"to 






<d 


CO 


o 




E 


T3 


O 


V 


0) 


CO 


loci 


Q. 


o 


-Q 


v_ 

O 





CN 



CO 
T3 
C 

o 



o 
o 



73 



EP 0 820 195 A2 



FIG. 24 



( ■« J 



make block 



classify class 



read predictive 
coefficients 



S91 



S92 



-S93 



calculate predicted 
value 



— S94 



74 



EP 0 820 195 A2 



in 

CM 

CD 

Li- 




75 



EP0 820 195 A2 



FIG. 26 



Q START 



calculate most suitable corrected data 



K-S101 



| blocking 



ADRC, sorting 



-S102 



-S103 



combine and store most suitable corrected 
data at the address corresponding to the 
class information and the learning data 



S104 



one frame complete? 



S105 



, y ES ^S1 06 

gleaming data finished? ^ Mn 
lYES 



generate a regular equation 



-S107 



calculate mapping coefficients ~"-S108 



store 



-S109 



( END ) 



76 



EP 0 820 195 A2 



9 
E 

I 

o 

CD 



O) 



CM 

d 

Li. 



CO 



CO 

© c 

.> © 

Pi 

a 
< 



c 
o 

o o 



c 

« v> § 

CO 



Is 

C CO 
O 



CD 



.-SS CD 
C =1 

*= © « 



I- 

-Q o 



c 



8 




77 



BP 0 820 195 A2 



CD 
O 

S T3 

E °> 

to .E 

C T3 

2 o 
— o 
o © 



CO 
CM 



CO 

*n 

"O 
CD 
"D 

o 
o 



in 



o 

X 
JD 
CL 



CO 
CM 

d 



m 

CD 



0) 



it 

9- ° 
o o 



CD tO 

O o 
o J5 

S S 

T3 <J> 

a> w 



CM 



co 
o 



c 

CD 

;o 

*CD CO 
O CO 

o _ca 
a? o 
> .c 
3 g 

T3 CD 
CD i_ 



CM 
CM 



i 1 

CD 



g> 

co 

s 

c 

8 



T3 

<D CD 

*o CO 

CD > 



CD 

-2 CD 



CM 



CO 

■o 

"D 

£ 

o 
o 



.i 1 i 

CO i 
CO — ■ OJ 

a> *c c 

r| 

o £ 



CO 
ra 

■o 

CD 
CD 
CO 

E 



78 



EP 0 820 195 A2 



FIG. 29 



( sa " ) 



make block 



classify class 



-S21 



-S22 



read predictive 
coefficients 
corresponding to class 



execute adaptive 
process to calculate 
predicted value 



S23' 



-S24' 



output predicted value 
and predictive coefficients 
for each class 



S2S' 



79 



EP 0 820 195 A2 



CO 

CD 




CM 







c 






o 


cn ^ 01 


2 c .E 




E 


c 


o 
o 





T3 

QJ 
CD 

as 

e 



80 



EP0 820 195 A2 



FIG. 31 



Q start j) 



correct 
compression data 



-S6 



compress data 
(thinning) 



limit level 



execute local decode 



-S1 



S2 



-S3 



calculate error 



— S4 



NO 



<f error <e ? J> 





YES 


output optimum 
compressed data j 







-S7' 



Q end 



81 



EP 0 820 195 A2 



CM 
CO 

g 

UL 




. CO 



CM 

cm| 



| 8 

| o 

C CO 
J* CO 

O o 
O 



— CD 
C = 

-Q O 



CM 



2 

CO 



o 

g 

o 
o 



82 



EP 0 820 195 A2 



FIG. 33 



( ) 



make block 



classify class 



-S21 



S22 



read out predictive 
coefficients 
corresponding to class 



execute adaptive 
process to calculate 
predicted value 



output predicted value 



-S23' 



S24' 



-S25' 



83 



EP 0 820 195 A2 



o 

CO 

cn 

9? 



CO 
T3 

T5 
<D 
V) 

CO 

£ 

CL 

E 
o 
o 



CL 

o 



o 
o 



C 



CO 

d 




CM | 



CO 
CO 



84 



EPO 820 195 A2 



LO 

CO 

d 

u. 



CO 



u 
0) 



CO 
LU 




CM 

co 



to 

CO 



CO 

CO 




CO 
LU 



o- 
V 



CO 

E 



o 
2 



II 

'•i= CO 

c g 

5 £ 

O Q. 

1 L_ 

o o 



.2 .2 
ns "5 

§§ 

o o 
e c 

I— 1_ 
CD CD 



o 



<n CO 
> 



CD 

O — 

W m O 0) Q- 

-=r -t? 



o-= O w O 

- r ? O*- m 

c E fc Q_*s ® 

o o o o_ J5 E 

o H o o S s 



CO 

7 







CD 










3 






to 




co 




CD 


CO 




> 


i 

o 


E 


o 




c 






CO 




o 


co 


CO 






CO 




o 


CO 


rrec 


CD 


o 


c 


E 


E 


rev 


8 


o 


o 


CO 




o 


CO 





85 



EP0 820 195 A2 



8 

03 



CO 
CO 

d 




86 



